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ABSTRACT 

We  use  the  Bouligand  contingent  cone  to  a  subset  K  of  a  Hilbert  space 
at  x  e  K  for  defining  contingent  derivatives  of  a  set  -  valued  map,  whose 
graphs  are  the  contingent  cones  to  the  graph  of  this  map,  as  well  as  the  upper 
contingent  derivatives  of  a  real  valued  function.  We  develop  a  calculus  of 
these  concepts  and  show  how  they  are  involved  in  optimization  problems  and  in 
solving  equations  f (x)  =0  and/or  inclusions  0  e  F  (x) .  They  also  play  a 
fundamental  role  for  generalizing  the  Nagumo  theorem  on  flow  invariance  and 
for  generalizing  the  concept  of  Liapunov  functions  for  differential  equations 
and/or  differential  inclusions. 

AMS(MOS)  Subject  Classification.-  47H10,  47H15,  47H99,  49B30,  49B99 

Key  Words:  contingent  cones,  contingent  derivatives,  nonlinear  equations 
set-valued  map 

Work  Unit  Number  1  -  Applied  Analysis 


SIGNIFICANCE  AND  EXPLANATION 


In  recent  years,  the  concept  of  multifunction  (or  set-valued  mapping)  has 
proved  increasingly  useful.  A  multifunction  F  is  a  mapping  x  ■+■  F(x)  such 
that,  for  each  x  ,  F (x)  is  a  set  (rather  than  a  point,  as  would  be  the  case 
if  F  were  a  function  in  the  usual  sense) .  In  this  paper  we  propose  a  defini¬ 
tion  of  derivatives  for  such  a  multifunction,  and  we  go  on  to  develop  some  of 
its  properties  and  applications.  The  key  to  the  definition  is  to  consider  the 
graph  of  F  ;  i.e.  the  set  of  all  points  (x,y)  such  that  y  e  F(x).  We  take 
the  tangent  cone  to  this  graph  at  a  particular  point  (x^,y^),  and  we  define 
the  derivative  of  F  at  to  t'rie  mu^t:'-^unct^on  whose  graph  is  this 

cone.  (One  discerns  here  an  analogue  of  the  familiar  property  of  differentiable 
functions:  the  tangent  line  to  the  graph  of  F  at  the  point  (x0,F(xq))  has 
slope  F’(x).)  The  question  arises  as  to  what  tangent  cone  to  choose.  If  the 
graph  of  F  is  convex,  there  is  no  ambiguity.  If  not,  we  have  the  choice  be¬ 
tween  the  Bouligand  contingent  cone,  which  is  large  but  not  necessarily  convex, 
and  the  Clarke  tangent  cone,  which  is  always  convex,  but  "too  small"  in  some 
instances .  We  choose  in  this  paper  the  Bouligand  tangent  cone  because  it  appears 
naturally  in  the  following  contexts: 

-  studying  necessary  conditions  in  nonsmooth  optimization  problems  and 
sensitivity  analysis 

-giving  sufficient  conditions  for  the  existence  of  solutions  to  inclusions 
0  e  F (x) 

-  giving  necessary  and  sufficient  solutions  for  trajectories  of  a  differen¬ 
tial  inclusion  to  remain  in  a  given  subset  (invariance) 

-  giving  necessary  and  sufficient  conditions  for  trajectories  of  a  differen¬ 
tial  inclusion  to  satisfy  conditions  of  the  form:  t  -*•  V(x(t))  is  non-decreasing 
(stability) . 

The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


contingent  derivatives  of  set-valued  maps 

AND  EXISTENCE  OF  SOLUTIONS 
TO  NONLINEAR  INCLUSIONS  AND  DIFFERENTIAL  INCLUSIONS 

Jean  Pierre  Aubin 

Introduction 

Everyone  knows  the  crucial  importance  in  both  pure  and  applied  analysis  of  the 
concept  of  derivative  of  a  function  or  a  distribution  discovered  by  Laurent  Schwartz. 

Let  V  be  a  locally  integrable  function  defined  on  an  open  set  .  -  Ipn  and 

n  •  v ( «+hv)  —  V ( • ) 

v  €  3R  .  We  form  the  differential  quotients  V^V(*fv)  =  - - -  .  Instead 

of  requiring  that  V^V(*,v)  converges  for  the  topology  of  the  pointwise  convergence, 

one  is  still  content  with  the  much  weaker  convergence  of  7,V(*,v),  in  the  space  of 

h 

distributions.  In  other  words,  one  can  find  a  weak  enough  topology  that  allows  the 

convergence  of  the  differential  quotients  V.V(*,v). 

h 

However,  many  problems  arising  in  nonlinear  analysis,  in  optimization  and  differential 

equations  still  require  the  pointwise  convergence  of  the  differential  quotients 

but  allow  to  use  limsup  or  liminf  instead  of  the  limit.  This  was  already  proposed  by 

Dini  when  V  is  a  locally  Lipschitzean  function.  Few  years  ago,  Clarke  suggested  to 

use  limsup  V,V(y,v),  whose  charm  lies  in  the  fact  that  it  is  always  convex  and  continuous 
h-»-0+  h 
y+x 

with  respect  to  v. 

We  propose  in  this  paper  to  take  in  consideration  another  candidate,  namely 

liminf  V  (x,w).  The  main  justification  for  this  is  that  it  works  well  for  solving  the 
h-*-0+  " 

w->v 

problems  we  were  studying:  we  hope  to  convince  the  reader  by  presenting  some  results  in 
the  following  pages. 

Also,  this  concept  can  be  defined  not  only  for  real  valued  functions,  but  can  be 

adapted  for  vector-valued  as  well  as  set-valued  maps. 

Indeed,  one  way  to  see  this  is  to  consider  the  graph  of  a  map.  If  we  can  define  a 

tangent  space  to  this  graph,  then  we  know  that  it  is  the  graph  of  its  derivative.  If 

not,  we  can  still  define  a  "tangent  cone"  to  this  graph  and  decide  to  look  at  it  as 

the  graph  of  some  set-valued  map  that,  hopefully,  retains  enough  properties  of  a 
Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-75-C-0024. 


would-be  derivative  to  deserve  to  be  presented  to  the  public. 


As  a  seducing  candidate,  we  can  think  to  the  Clarke  tangent  cone,  which  is  always 
closed  and  convex.  But  there  is  an  older  candidate,  the  contingent  cone,  introduced 
by  Bouligand  in  the  early  1930's,  in  connection  with  the  theory  of  derivatives  of 
functions  of  one  or  two  variables.  We  claim  that  it  would  be  unwise  to  bury  and  forget  it. 

The  contingent  cone  D  (x)  is  defined  by 

k 

(1)  D  (x)  =  n  U  (i.  (K-x)  +  eB). 

a>0  he]0,a[ 

E>0 

For  this  literature,  see  S.  Saks  [1],  R.  T.  Rockafellar  [5], 

We  note  that  when  Int  K  *  0  and  when  x  e  Int  K,  then  D  (x)  =  X  .  So,  conditions 
involving  the  contingent  cones  are  boundary  conditions,  in  the  sense  that  they  are  trivial 
when  x  e  Int  K.  In  1943,  Nagumo  [1]  proved  that  if  a  continuous  and  bounded  map  f  from 
K  to  IRn  satisfy 

(2)  ¥  x  e  K  ,  f  (x)  £  Dk<x) 

then  there  exists  a  trajectory  x ( • )  of  the  differential  equation 

(3)  x'  =  f(x)  ,  x{0)  =  xQ  where  xQ  is  given  in  K 

that  remains  in  the  closure  of  K  .  Moreover,  if  for  all  x^  e  K  ,  there  exists  a  tra¬ 
jectory  of  the  differential  equation  that  remains  in  K  ,  condition  (2)  is  satisfied. 

Analogous  statements  remain  true  for  differential  inclusions  (see  Haddad  [1],  Aubin- 
Cellina-Nohel  [1]  when  K  is  convex  and  Aubin-Clarke  [1]). 

Also,  we  can  use  this  contingent  cone  to  solve  nonlinear  equations. 

For  instance,  let  f  be  a  continuously  differential  map  from  a  neighborhood  of  a 
compact  subset  K  c  e”  to  IR^.  Assume  that 

(4)  V  x  e  K  ,  a  u  e  D  (x)  such  that  Vf(x)u  =  -f(x). 

K 

Then  there  exists  a  solution  x  e  K  to  the  equation  f(x)  =  0  (See  Aubin-Clarke  [2]). 

We  shall  extend  this  result  to  inclusions  0  e  F(x)  as  well  as  finding  other  results 
in  this  direction. 
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Finally,  in  optimization  theory,  contingent  cones  play  a  role.  For  instance,  if 
Xq  e  K  minimizes  a  continuously  differentiable  function  U  defined  on  a  neighborhood 
of  K  ,  then 

(5)  Vue  Dr(x0)  ,  <  VU(xQ)  ,u  >  >_  0  . 

These  results  among  many  other  applications,  justify  a  further  study  of  contingent 
cones,  despite  the  unfortunate  fact  that  they  can  fail  to  be  convex.  If  one  need  con¬ 
vexity  (for  using  duality  correspondence  between  convex  cones  and  their  polars ,  for 
instance),  he  should  use  the  Clarke  tangent  cone.  (See  Clarke  (1],  [2],  [3]  and 
Rockafellar  [3],  [4],  [5]).  So,  we  face  the  dilemma  of  either  using  a  convex  tangent 
cone,  which  may  be  too  small,  or  using  the  contingent  cone  which  appears  naturally  in 
many  instances,  but  which  is  not  generally  convex.  Fortunately,  when  K  is  closed  and 
convex  or  when  K  is  a  smooth  manifold,  these  two  cones  coincide. 

We  proceed  as  in  elementary  calculus,  when  the  derivatives  of  real  valued  function 
are  defined  from  the  tangents  to  the  graph.  Actually,  if  F  is  a  set-valued  map  and 
if  ^xo'yo^  belongs  to  the  graph  Graph  (F )  of  F  ,  we  can  define  its  contingent  cone 

D  .  .  ix  .v  ) .  which  is  a  closed  cone  (not  necessarily  convex) .  We  define  the  contin- 
graph  (F7  0  0  - 

gent  derivative  DFtx^.y^)  of  F  at  x^  and  y^  e  F(xQ)  to  be  the  set-valued  map 

whose  graph  is  D  .  ,  . (x „,y  )  .  We  shall  characterize  the  contingent  derivative: 

^  graph(F)  00 

VQ  C  DF (xQ ,yQ) (uQ)  if  and  only  if 


graph (F) 


Again,  the  advantages  of  convexity  should  be  weighted  against  valuable  properties 
of  contingent  derivatives  in  the  field  of  nonlinear  equations  and  differential  equations 


What  about  real-valued  functions?  Since  a  real-valued  function  V  is  a  particular 


case  of  a  set-valued  map,  we  can  define  its  contingent  derivative:  v  e  DV(x  )(u  )  if 


In  many  instances,  the  order  relation  of  real  numbers  play  an  important  role:  this  is 


the  case  in  optimization  theory,  in  differential  inequalities  and  Liapunov  stability  of 


trajectories  of  differential  equations  or  inclusions.  In  this  point  of  view,  it  is 


natural  to  associate  with  a  real-valued  function  x  H-  V(x)  the  set-valued  map 


V+(x)  =  V (x)  +  1R+  (whose  graph  is  the  epigraph  of  V).  So,  we  check  that  the  contir 


is  the  half  line 


where 


We  shall  say  that  D+V(x^)  is  the  upper  contingent  derivative  of  V  .  By  using  the 
Clarke  derivative  of  V+  at  (x,V(x)),  we  obtain  the  Clarke  generalized  directional 
derivative  (see  Clarke  [1],  [2]  and  Rockafellar  [3],  [4],  [5]).  Let  us  mention  that 
the  variational  principle  holds  true.  When  V  is  a  function  from  K  to  1R  and  when 
xQ  e  K  minimizes  V  on  K  ,  then. 


» 


(9)  V  u  £  X  ,  0  <_  D+V  (xQ)  (u) 

What  makes  this  property  useful  is  the  calculus  of  upper  contingent  derivatives  for 


computing  D+V (x)  in  terms  of  derivatives  of  other  functions  from  which  V  is  con¬ 
structed.  As  an  example,  consider  the  case  where  V  =  u|R  is  the  restriction  to  K 
of  a  continuously  differentiable  function  U  .  One  can  prove  that 


(10) 


J<TO(x  ),u 

VW  =  1 


when  uQ  €  Dr(x0) 
when  uQ  {  Dk(xq) 


So,  property  (9)  becomes 


(11)  VueDK(xQ),  0  _<  <  VU  (xQ)  ,u  > 

or,  equivalently,  if  DR(Xg)  denotes  the  negative  polar  cone, 

(12)  -VU(xQ)e  Dr (xQ)  ~  . 

Contingent  derivatives  do  play  an  important  role  in  sensibility  analysis  for  optimiza¬ 
tion  problems ,  which  is  of  upmost  relevance  in  economics ,  for  instance .  Let 
F : K  c  *  JRm  be  a  compact -valued  map  and  U:F(K)  x  K  -*•  1R  be  a  real  valued  func¬ 
tion  (x,y)  -*-U(x,y)  which  is  lower  semicontinuous  with  respect  to  x  .  We  define 
the  marginal  function  v  by 

(13)  V (y)  =  min{u(x,y)  |x  £F(y)} 
and  the  marginal  (set-valued)  map  G  by 

(14)  G(y)  =  (x  £  Fly)  |  U(x,y)  =  V(y)  }  . 


We  shall  prove  the  following  facts: 

V  vQ  e  Dom  DF(y0,xQ),  V  uQ  £  DF (yo'xo> <V0>  we  haVe 

*  (15)  D+  v(y0’ +  D+<_U)  <X0'y0)  <U0'V0)  -  ° 

and,  for  the  contingent  derivative  of  the  marginal  map  G  ,  V  vQ  £  Dom  DG(y0,xQ) , 

T  V  u0  e  DG(y0,xQ) (vQ) ,  we  have 
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-i 


. 


(16)  D+  U(X0'y0)  W  +  D+(_v)  ‘Vo*  (V  -  °- 

In  this  line  of  thought,  we  can  state  a  differential  version  of  Ekeland’s  varia¬ 
tional  principle:  Let  K  be  a  closed  subset  and  V:K  -*•  [0,°°[  a  lower  semicontinuous 

function.  Then  we  can  associate  with  any  e  >  0  and  x  e  K  satisfying  v(x  )  _< 

2  -  e  — 
mf  V  (x)  +  e  an  element  x_  c  K  which  satisfies 


(17) 


i) 

ii) 


II  X  -  X  II  <  E 
E  £  — 

V  u  e  X  ,  0  <_  D+v(xe)  (u)  +  Ellull  . 


This  result  is  as  useful  as  the  original  version  of  Ekeland's  theorem. 

It  yields  surjectivity  theorems  and  inverse  function  theorems.  For  instance,  we  shall 
prove  that  when  an  upper  semicontinuous  map  F  from  a  closed  subset  K  c  x  to  the 
compact  subsets  of  Y  satisfies 

3  c  >  0  such  that,  V  x  e  K  ,  V  y  e  F(x),  V  v  e  Y  , 


(18)  j 

3  u  €  X  satisfying  v  e  DF(x,y)  (u)  and  ellull  <_  llvll 
then  F  maps  K  onto  Y  . 

We  also  shall  use  this  kind  of  approach  for  solving  inclusions  0  £  F(xt).  (We  shall 
say  that  x„  is  a  stationary  point  of  F  .  ) 

We  introduce  two  functions 

(19)  V:K  -*■  1R+  and  W:K  x  co(F(x))  -*•  1R+ 

and  we  shall  say  that  V  is  a  Liapunov  function  for  F  with  respect  to  W  if 

(20)  V  x  e  K,  3  v  £  F(x)  such  that  D+V(x)  (v)  +  W(x,v)  ^  0  . 

We  shall  observe  that  when  V  is  lower  semicontinuous  and  lower  semicompact  (i.e., 
the  subsets  {x  £  K  |  V(x)  <_  A]  are  relatively  compact  for  all  X  e  XR)  , 

(21)  there  exists  x,  e  K  and  vt  e  F(x„)  such  that  W(xt,v4)  =  0  . 

We  note  that  when  we  assume  that  W(xt,v4)  =0  if  and  only  if  v,  =  0  ,  such  an  xt  is 
a  stationary  point  of  F  .  This  is  not  all.  Assume,  for  instance,  that 


(22) 


i) 

ii) 


iii) 


F  is  bounded,  upper  semicontinuous  and  has  compact  convex  values 
V  is  continuous  and  lower  semicompact 
W  is  continuous  and  is  convex  with  respect  to  v  . 
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We  shall  prove  that  v  is  a  Liapunov  function  for  F  with  resepct  to  W  if  and  only  if 
for  all  XQ  e  K  ,  there  exists  a  trajectory  x(-)  e  C(0,°°; JRn)  of  the  differential  inclu¬ 
sion 

(23)  x1  e  F (x)  ,  x (0)  =  xQ 
which  is  monotone  in  the  sense  that 

(24)  V  s  >  t ,  V  (x  (s) )  -  V  (x  (t) )  +  W(x  (t)  ,x’  (t)  )dt  £  0  . 

s 

In  this  case,  subsequences  x(t  )  and  x' (t  )  have  "almost  cluster  points" 

n  n 

xt  e  K  and  v„  e  F(xt)  satisfying  property  (22),  where  "almost  cluster  points"  are 
analogs  for  measurable  classes  of  functions  of  cluster  points  for  usual  function.  Monotone 
trajectories  yield  informations  on  the  behavior  of  the  nonincreasing  function  t  -*■  V(x(t)) 
when  t  ■*  °°.  We  also  prove  that  under  assumptions  (22)  i)  and  iii)  ,  the  function 
defined  on  K  by 

(25)  Vp  (Xq )  =  inf  {/  W(x(t)  ,x'  ( t )  )dt  when  x ( • )  is  a  solution  to  (23)  }, 

is  the  smallest  Liapunov  function  for  F  with  respect  to  W  when  Liapunov  functions  do 
exist.  This  provides  a  bridge  between  Liapunov  stability  theory  and  Caratheodory- 
Bellman  approach  to  optimal  control  theory. 

I  would  like  to  thank  Georges  Haddad  for  his  hidden  but  important  contribution  as 
well  as  Arrigo  Cellina,  Bernard  Cornet  and  Ivar  Ekeland. 
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We  shall  define  the  Bouligand 


(') 

Let  K  be  a  nonempty  subset  of  a  Hilbert  space  X. 
contingent  cone  as  follows. 

Definition  1 

We  say  that  the  subset 


(i)  d  (x)  =  n  n  u  (  ^-(k-x)  +  eb) 

e>0  a>0  0<h<^  a 

is  the  "contingent  cone'*  to  K  at  x  . 

In  other  words,  v  e  D^lx)  if  and  only  if 

(ve>0,  V  a  >  0  ,  3  u  e  v  +  eB  ,  3hf  10,o] 


(2) 


such  that 


|  x  t  hu  £  K  . 

It  is  quite  obvious  that  D^(x)  is  a  o^osed  cone  ,  which  is  contained  in  the  closed 

cone  Tr(x)  defined  by 

T  (x)  ic«(  U  i-(K-x) ) 

K  h>0  h 

They  coincide  when  K  is  a  closed  convex  subset.  (See,  for  instance,  Rockafellar  [5]). 
We  also  note  that 

(3)  if  x  e  Int  (K)  ,  then  DR(x)  =  x  • 

We  characterize  the  contingent  cone  by  using  the  distance  function  d^t*)  to  K 
defined  by 


dj,(x)  =  inf {II x-yll  |y  e  K}. 


Proposition  1 

dR(x  +  hv) 

v  e  D  (x)  if  and  only  if  lim  inf  - r -  =  0  . 

K  h  ■>  0+ 

Proof. 


a)  . 

such  that 

V  E  >  0, 

b) . 


Let  v  e  D  (x) .  For  all  £  >  0  ,  a  >  0  ,  there  exist  h  e  )0,a]  and  u  e  v  + 
d  (x+hv) 

x  +  h  u  e  K  .  Hence  - - -  <  —  llx  +  hv  -  (x  +hu)ll  <  llu-vll  <  E.  So, 

h  —  h  —  — 


0  <_  sup  inf 
a  h<a 

Conversely, 


d  (x+hv)  d^ (x+hv) 

K—  — • —  <  e.  This  proves  that  lim  inf  —  -■■■ -  =  0  . 

h  “  h  +  0+  h 

dK (x+hv)  dR(x+hv) 

if  lim  inf  - — -  =  sup  inf  - - -  =  0  ,  we  deduce  that 

h  -+  0+  a>0  h<a 


(') 


For  simplicity. 


Several  results  of  this  paper  are  true  for  topological  vector  spaces . 


eB 


dK(x+hv) 

ve>0,  Va>0,  3h<_a  such  that  - - -  <_  e/2.  Thus,  there  exists  ye  K  such  that 

II  x+hv-vll  Vx+hv) 

- ^ —  — - h -  +  z/2  ‘  Hence  u  =  £  v  +  eB  and  satisfies  x  +  hu  =  yeK." 

Remark. 

We  recognize  the  "Nagumo  condition"  implying  the  existence  of  trajectories  remaining 
in  a  given  subset  K  .  ■ 

We  can  also  characterize  the  contingent  cone  in  terms  of  sequences. 

Proposition  2 

V  €  ^  and  only  ^  there  exists  a  sequence  of  strictly  positive  numbers  h 

and  of  elements  u^  t  X  satisfying 

(4)  i)  lim  u  =  v  ,  ii)  lim  h  =  0  ,  iii)  V  n  >  0  ,  x+hu  eK. 
n-~»  n  n-x»  n  “  n  n 

Proof.  It  is  left  as  an  exercise. 

Remark. 

.  For  all  x  €  X  ,  we  have  Dx(x)  =  X  .  We  shall  set  D^(x)  =  0.  ■  *• 

Remark . 

It  is  easy  to  see  that  the  contingent  cone  to  K  and  the  contingent  cone  to  the 
closure  K  of  K  coincide: 

v  X  e  K  ,  dk(x>  =  D-tx)  . 

Therefore,  there  is  no  danger  in  speaking  of  DK(x)  even  when  x  £  ic  and  x  ^  K  .  • 
Proposition  3 

Let  K  c  x  be  a  closed  subset.  We  denote  by  ^(y)  the  subset  of  elements  x  €  K 
such  that  II  x— y  II  =  d^ty).  We  obtain  the  following  inequalities 

V  y  ^  K  ,  V  x  e  1TK<y) ,  V  v  £  co  D R(x)  ,  then  <  y  -  x,  v  >  <_  0  .  • 

Proof . 


Let  x  £  n^(y)  and  v  e  D^(x).  We  deduce  from  the  inequalities  lly-xll 
dR(y)  -  dR(x  +  hv)  <_  II  y  -  x  -  hvll  that 


dR(x  +  hv) 


<y  -  x,v  >_  lly-xll  -  lly-x-hvll  ..  .  . 

i  .  "'i.  =  - r— 1 -  <  lim  inf 


dK(x+hv) 


II  y-x 


0+ 


0+ 


for  yM,u<  Hull  is  differentiable  at  u  ft  0  and  v  e  Dr(x)  .  So  <y  -  x,v  >  <  0 


for  all  v  £  D  (x) ,  and,  consequently,  for  all  v  £  co  D  (x)  . 


We  deduce  from  this  proposition  a  criterion  of  convexity  of  the  contingent  cone . 


j  4 


Let  us  recall  that  a  set-valued  map  F  from  M  to  N  is  lower  semicontinuous  at 
xq  e  M  if  for  any  e  >  0  and  for  any  y^  €  F(x^)  there  exists  n  >  0  such  that, 
F(x)  n  (yQ  +  e  B)  ^  0  for  all  x  f  xQ  +  nB. 

Theorem  1  (B.  Cornet) 

Let  us  assume  that 

(6)  x  €  K  ^  co  D  (x)  is  lower  semicontinuous  at  x.  €  K  . 

K  0 

Then  the  contingent  cone  D  (x  )  to  K  at  x^  is  a  closed  convex  cone.  ■ 

0  0 

Proof. 


a)  Let  v  €  co  D  (x  ) .  For  proving  that  v  t  Dv(x  ),  fix  e  >  0  and  let 
h  =  g(e)  such  that,  thanks  to  (6), 

DV(X)(V  ±d£5  D  (x  )  <V0)  +  C/2  When  I|X-X0"  -  0  • 

K  K  0 

We  take  h  =  o/2IIVqII  and,  for  t  e  ]0,h[,  we  set  yfc  =  xQ  +  t  vQ,  we  choose  xfc  e  u  (y ) 

and  v  =  tt —  (x  )  .  Hence  Proposition  3  implies  that 

t  coD^x^)  0 


(3) 


<  y t  -  xt  /  vt  >  1  0  . 


We  observe  that  II  x  -x  II  <  llx.-y.ll  +  lly  -xjl  <  2  II  y  -xjl 

to—  t  t  to—  to 

(8)  II  xt~ytH  £  2tll  vQll  n  when  t  <_  h 

and  thus , 


(for  xfc  e  -  <y  )).  Consequently, 


(9) 


II v,.— =  d —  ,  (v  )  <  e/2, 

to  co  DK(xt>  0  — 


Hence,  inequalities  (  7  ) ,  (  8  )  and  (  9  )  imply 

(10)  <yt-xt'vo  >  1  <yt-xt'vo_vt  >  +  <yt*xt'vt>-  11  y t-31^1  llvo-vtH  -  2te/2  • 

Let  us  set 

f(t)  =  *dK(xQ+tv)2  . 

It  is  a  locally  Lipschitzean  function,  which  is  thus  almost  everywhere  differentiable. 


Hence 


■7  d  (x  +h  v  )2  =  f(h)  -  f (0)  =  /h  f'(t)dt  c  e  Jh  tdt  =  -7- 
2  K  0  0  0  0  2 


This  implies  that 

liminf 

h->0+ 


dK(X0+hv0) 


/T, 


Since  £  was  chosen  arbitrarily,  we  deduce  that  liminf 

h-K)+ 

v  e  D  (x  ) .  We  have  proved  that  co  D„(x_)  =  D  (x  ) . 

U  K.  U  K  0  K  U 

We  mention  the  following  consequence. 

Theorem  2  (Cornet) 

Let  us  assume  that  X  is  finite  dimensional  and  that 
(11)  x  c  K  D^(x)  is  lower  semicontinuous  at  x^  . 


WhV 


=  0  ,  i.e. ,  that 


Then  D  (x  )  is  a  closed  convex  cone  and 

d  (x+hv  ) 

lim  liminf  - : -  =  0 


(12) 


V  V0  e  W  ' 


x->x„ 

xcK° 


h-*0+ 


Proof . 


We  recall  that  the  lower  semicontinuity  of  x  |*  D  (x)  at  x  implies  that  the 

K  0 

negative  polar  cone  DK<»)  satisfies: 

For  all  sequence  of  elements  x^  e  K  converging  to  xQ  £  K  and  for  all  sequence 

of  elements  p  e  N  (x  )  converging  to  p  ,  we  have  p  e  N  (x  )  . 

n  K  0  0  0  K  0 

When  X  is  finite  dimensional,  this  latter  property  implies  that  the  set-valued  map 

x  (*  co  D  (x)  is  lower  semicontinuous  at  x„  e  K  .  (See  J.  P.  Aubin  and  A.  Cellina  [  1 
k.  0 

Hence  D„(x„)  is  a  closed  convex  cone  by  Theorem  1.  Let  v_  be  chosen  in  D._(x_) 

K.  U  ■  1  u  K  0 

and  let  us  associate  with  any  x  e  K  an  element  v  e  D„(x)  such  that  llv  -vll  = 

K  0 

dn  t  i  (v_)  •  Since  x  (*  D  (x)  is  lower  semicontinuous  at  x„,  there  exists  g  >  0 
K  *X '  OK  0 

such  that  II  v-v0ll  =  dD  ^  (vQ)  £  dD  ^  ^  (vQ)  +  e  =  e  whenever  II x-xQll  <_  g  .  Therefore 
for  all  h  >  0  , 


dK(x+hvQ)  -  dK (x+hv) 


<.  II  v— vQll  <_  e. 


Since  v  £  D  (x)  ,  we  deduce  that  for  all  x  e  x  +  nB, 

In  U 


d^(x+hv  )  dR(x+hv) 

liminf  - - -  <  liminf  - - - 


+  e  =  c. 


h-*0+ 


h-K)+ 
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2 .  Calculus  on  contingent  cones 


Let  K  c  L  c  x  be  two  nonempty  subsets.  Then 


Let  K  =  UK.  be  the  union  of  subsets  K 
id  1 

I  such  that  x  £  K,}.  Then 


V  x  £  K  ,  U  D  (x)  c  D  (x)  . 

i  £  I  (x)  Ki  K 

If  I  is  finite  or,  more  generally,  locally  finite  in  the  sense  that  there  exists 


r  >  0  such  that  x  +  rB  meets  only  a  finite  number  of  K 


The  first  inclusion  is  obvious.  For  proving  the  opposite  inclusion,  take  v 


Then 


There  exists  n  such  that,  for  all  n  >  n 


which  is  finite  by  assump¬ 


tion.  Then,  Vn>n,x  +  hue  U  K..  Therefore,  there  exists  at  least  an 
—  r  n  n  .  ,  ,  ,  i 

ielr (x) 

index  i  e  I  (x)  and  an  infinite  subsequence  such  that 


This  proves  two  facts.  First,  that  v  £  D  (x)  and  second,  that  x  £  cMK 


Then 


that  x 


Proof . 


It  is  left  as  an  exercise. 


Proposition  4 

Let  K  =  n  K. 

iel  1 


be  the  product  of  a  family  of  nonempty  subsets  of  Hilbert  spaces 


Xi  .  Then 

(5)  V  X  e  K  ,  D  (x)  C  n  D„  (x.)  .  ■ 

if  i  i 

Proof .  It  is  left  as  an  exercise. 

The  following  proposition  gives  some  information  about  the  contingent  cone  of  the 
image  of  a  subset  by  a  smooth  map. 

Proposition  5 

Let  X  and  Y  be  two  Hi Ibert  spaces ,  K  c  x  be  a  subset  of  X  and  A  be  a  con¬ 
tinuously  differentiable  map  from  an  open  neighborhood  of  K  to  Y  .  Then 


<6>  V  x  e  K  ,  VA(x)Dr(x)  c  Dfl(K)(Ax)  .  ■ 

Proof .  Let  v  £  D^(x) ,  e  >  0  and  a  >  0  .  Since  A  is  continuously  differentiable, 
there  exist  S  >  0  ,  n  >  0  such  that,  ¥  h  <_  B  and  for  all  u  e  v  +  nB  ,  A(x  +  hu)  = 

A(x)  +  hVA(x)u  +  he  -where  S  t  jh.  Let  5  =  min  (  ^TvAOOTi  ‘  n)  an*d  'Y  “  min  (a,  6). 

Since  v  £  DR(x)  .  there  exists  h  <  y  and  u  e  v  +  <5B  such  that  x  +  hu  e  K  .  Hence 
A(x)  +  h  ( VA (x) u  +  e)  =  A (x  +  hu)  e  A (K)  and  l|VA(x)u  +  e  -  VA(x)vll  <_  s/2  +  IIVa(x)IIS  <_  e  . 
This  states  that  VA(x)v  f  dA(Kj  (**)  •  ■ 

In  particular,  if  A  e  f(X,Y),  we  obtain  the  formula 
<7)  V  x  e  K  ,  A  Dr(x)  c  (A(x)) 

We  study  now  the  contingent  cone  to  the  preimage  of  a  set  by  a  smooth  map: 

Proposition  6 

Let  X  and  Y  be  two  Hilbert  spaces  ,  Lex  and  M  c  y  be  two  subsets  and 
A  be  a  continuously  differentiable  map  from  an  open  neighborhood  of  L  to  Y  . 

We  set 

(8)  K  =  {x  e  L  |  A(x)  £  M}  =  L  n  A-1  (M)  . 

Then, 

(8)  V  x  e  K,  D  (x)  c  D  (x)  n  VA (x) -1  •  D  <A(x)).  • 

Li  M 
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3.  Contingent  derivative  of  a  set-vaiued  map. 


We  adapt  to  the  case  of  a  set-valued  map  the  intuitive  definition  of  a  dc-rivat  : 

a  function  in  terms  of  the  tangent  to  its  graph . 

Let  F  be  a  proper  set-valued  map  from  K  c  x  to  Y  .  (We  say  that  F  is  proper 

if  its  images  F(x)  are  nonempty  for  all  x  e  K)  .  Let  x^  •:  K  and  y ^  f(xq). 

We  cjenote  by  DFtx^.y^)  the  set-valued  map  from  X  t£  Y  whose  graph  is  the  con¬ 
tingent  cone  Dgraph(p) (x0,y0>  to  the  graph  of  F  at  <x0,yQ) .  • 

In  other  words , 

(1)  v0  e  DF(x0,y0)(u0)  if  and  only  if  (u^)  e  Dgraph  (p)  <xQ  ,yQ)  . 

Definition  1 

We  shall  say  that  the  set-valued  map  DF(xg,y^)  from  X  to  Y  is  the  "contingent 
derivative"  of  F  at  xQ  e  K  and  yQ  e  F(xQ).  ■ 

It  is  a  positively  homogeneous  set-valued  map  (since  its  graph  is  a  cone)  with 
closed  graph.  Also,  we  note  that 


■(2) 


Do*  BF  (x-Q  ,  yQ-)  c.  Dj-  (xQ ) 


i.e.,  that  the  domain  of  DF(xg,yg)  is  contained  in  the  contingent  cone  to  K  at  x^. 
We  first  point  out  that 

(3)  V  xn  e  K  ,  Vyn£F(xn),  DF  (xQ ,yQ) _1  =  D (F_1 )  (yn ,xn)  . 


'0'  0 


Indeed,  to  say  that  (u0,vQ)  £  Dgraph (F)  **0 ,yo'  amounts  to  saying  that  (v0,uQ) 

D  -i  w-  • 

graph (F  ) 

Ex^ngle :  Indicator  of  a  set  and  its  contingent  derivative 

Among  the  set-valued  maps  from  X  to  a  Hilbert  space  Y  ,  we  single  out  the  "indicator" 
of  K  which  is  the  set-valued  map  fK  from  X  to  Y  defined  by 


yx>  = 


0  if  x  e  K 

0  if  x  ^  K  . 

Note  that  ^  depends  upon  the  choice  of  the  Hilbert  space  Y  .  We  recall  the 
following  conventions 

If  M  c  y  ,  then  M+0=0+M=  0 

and 


-16- 


■-  . . .  - K9BP 


I 

I 

I 


d(x,0)  =  +»  . 

Note  also  that  if  F  is  a  set-valued  map  from  X  to  Y  ,  then  F  »  :  yields  t:.e 

restriction  of  F  to  K  (since  (F+'i  y)  (x)  =  0  when  x  J  K). 

Proposition  1 

The  contingent  derivative  of  the  indicator  of  a  set  K  is  the  indicator  of  the 
contingent  cone  to  K  : 

(4)  V  x  e  K  ,  D¥k(x)  =  *^(x)  . 

Proof. 

Graph  [D*k(x)]  =  D  (<i  ,  (*.0)  =  DKx{0}  (x,0)  . 

K 

It  is  easy  to  check  that  dkx{o},,x'^  =  Dk^  X  So'  Graph  ID  .  K(x)]  =  '  :  = 

Graph  [iJiD  (x)  ]  . 

Characterization  of  the  contingent  derivative 

We  shall  give  an  analytical  characterization  of  DF(x^,y0>,  which  justifies  that 
the  above  definition  is  a  reasonable  candidate  for  capturing  the  idea  of  a  derivative  as 
a  (suitable)  limit  of  differential  quotients.  We  extend  F  to  X  by  setting  F(x)  =  0 
when  x  ^  K  . 

Theorem  1 

Let  F  be  a  set-valued  map  from  K  c  X  to  Y  and  (XQ » Yq )  e  graph(F).  Then 
vQ  e  DF (Xq/Yq) (Uq)  if  and  only  if 

F(x  +hu)  -  y 

(5)  lira  inf  d (v  ,  - ^-r - -  )  =  0  ■ 

h  -  0+  0  h 

u  -  u0 

Proof. 

To  say  that  vQ  c  DF  (xQ ,yQ)  (uQ) ,  i.e.,  that  (u0,vQ)  £  Dgraph (p) (xQ ,yQ)  ,  amounts  to 

saying  that  for  all  c1>£2  5  0  and  a  >  0  >  there  exists  u  c  uQ  +  e^B  and  v  •.  vQ  +  t^B 

F(xq  +  hu)  -  yQ 
such  that  v  e  - - - 
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This  is  equivalent  to  say  that  V  >  0  ,  >  0  •  a  >  0  ,  we  have 


inf 


inf 


h<a  llu-Ugll<e^ 


F(xo+hu)  '  yo 


'o' 


The  last  statement  is  equivalent  to  (5) . 

When  F  is  a  single  valued  map,  we  set 


(6) 


DF(xQ,y0)  =  DF(xQ) 


since  y^  =  F(x^).  The  above  formula  shows  that  in  this  case,  vQ  e  DFlx^MUg)  if  and 
only  if 


(7) 


lim  inf 
h  ■*  0+ 
u  -*•  u„ 


II F  (x^+hu)  -  F  <Xq)  -  hvQll 


0. 


If  F  is  a  single-valued  map  which  is  regularly  Gateaux  dif f erentiable , in  the  sense 
that  there  exists  VF(x)  £  f  (X,Y)  satisfying: 


(8) 


V  u„£  X,  lim 
0  h  -  0+ 

•  *  ti*  >  u 


F(xQ+hu)  -  F(xq) 


=  VF(xQ)u0 


then  the  contingent  derivative  coincides  with  the  Gateaux  derivative : 


(9) 


V  u0  s  X  ,  DF(x0)(u0)  =  VF(x0)u0 


Ex^ngle  :  Contingent  derivatives  of  locally  Lipschitzean  maps ■ 

This  formula  has  a  simpler  form  when  the  set-valued  map  F  is  upper  locally 
Lipschitzean: 

Definition  2 

We  say  that  a  set-valued  map  F  is  "upper  locally  Lipschitzean  at  x^  e  Int  K"  if 
there  exists  a  neighborhood  N  (x^)  of  xQ  and  a  constant  l  >  0  such  that 


(10) 


V  x  £  N(xQ)  ,  F  (x)  c  F(xq)  +  III  x-Xgll  B 


Naturally,  any  locally  Lipschitzean  (and,  a  fortiori,  Litschitzean)  set-valued  map  is 
upper  locally  Lipschitzean. 
proposition  2 

Let  F  be  an  upper  locally  Lipschitzean  set-valued  map  from  Int  K  c  x  to  Y  , 

*o« Int  K  and  y0  e  F(V-  Then  v0  e  Dp(x0'y0)  ‘“o’  if  and  only  if 
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We  shall  derive  from  the  properties  of  the  contingent  cones  a  calculus  on  contingent 


derivatives  of  set-valued  maps.  We  shall  start  naturally  with  the  chain  rule: 

Proposition  1 

Let  F  be  a  set-valued  map  from  K  c  X  to  Y  and  A  be  a  continuously  differ¬ 

entiable  map  from  an  open  neighborhood  of  F (K)  c  y  to  Z  .  Then 

(1)  V  uQ  e  X  ,  VA(y0>  •  DF (xQ,y0) (uQ)  c  D (AF) (xQ , AyQ) (uQ)  ■ 

Proof . 

Let  (1  »  A)  be  the  map:  (x,y)  e  X  x  F(K)  (-►  (x,A(y))  e  X  *  Z  .  The  graph  G  of 

the  set-valued  map  x  **•  AF  (x)  is  related  to  the  graph  F  of  F  by  the  relation 
G  =  (1  x  a) F  .  By  Proposition  2.5,  we  know  that  (1  x Va (y  ) ) Dp (xQ ,y  )  c  Dg(xQ,Ay0).  Thi 
states  that  for  all  vQ  e  DF (x  ,yQ)  (uQ) ,  VA(yQ)v0  e  D (FA)  (xQ , AyQ) (uQ) .  • 

Proposition  2 

Let  F  be  a  set-valued  map  from  K  c  x  to  Y  and  A  be  a  continuously  differenti 

able  map  from  an  open  subset  SI  c  z  from  X  .  Then, 

(2)  V  uQ  e  Z  ,  D(FA)  (x0,yQ)  (uQ)  c  DF  (AxQ  ,yQ)  ( VA (xQ)  (uQ) )  .  ■ 

Proof. 

Let  (A  X  1)  if!  X  Y  -*■  K  X  Y  be  the  map  defined  by  (A  x  1)  (z,y)  =  (Az,y)  .  The  graph 

G  of  the  set-valued  map  FA  from  (1  to  Y  is  related  to  the  graph  F  of  F  by  the 

relation  G  =  (A  x  1)  *F.  By  Proposition  2.6,  we  know  that  Dp^xo'^o^  C  ^~A^xo*  x  D  * 

Dp (AXq ,y^ ) ,  This  states  that  for  all  uQ  e  Z  and  vQ  e  D (FA)  txQ ,yQ) (uQ) ,  then 
VQ  €  DF(AXQ,y0))  (VA(xQ)  (uQ) )  .  ■ 

We  state  now  the  properties  of  contingent  derivatives  of  unions  and  intersections 
of  maps . 

Proposition  3 

Let  us  consider  a  family  of  set-valued  maps  F^i  e  I)  from  K  to  X  and  set 
F (x)  =  U  FMx).  We  associate  with  any  xQ  e  K  and  yQ  e  F(xQ)  the  subset 

Kx0.yo>  ”  tt  £  I  |yQ  «  Fi(x0)}-  Then 


(3) 


Vuq£X,  U  DF.(Xo,yo)(u0)cDF(Vyo)(uo). 

ieI(x0'yo) 

Equality  holds  when  the  graphs  of  the  maps  F^  are  closed  and  when  the  family  is  local!'. 


We  note  that  the  graph  F  of  F  is  the  union  of  the  graphs  F^  of  F.  .  Hence 
Proposition  3  follows  from  Proposition  2.2. 


Proposition  4 


Let  us  consider  a  family  of  set-valued  maps  F^  (i  e  I)  from  K  to  X  such  that 

F(x)  =  n  F  (x)  0  0  for  all  x  e  K  .  Let  J(x  ,y0)  =  {i  e  I  such  that  (x0,yQ)  i 
id  1 


int (graph  (F . )  }  .  Then 


V  u0  c  X  ,  DF(x0,y0)(u0)  c  n  DF  (xQ fy  )  {u  )  . 

1<J(xo'V 


We  note  that  the  graph  of  F  is  the  intersection  of  the  graphs  of  the  maps  F^ 


and  we  apply  Proposition  2.3. 


We  turn  our  attention  to  the  study  of  contingent  derivatives  of  restrictions  First , 
we  begin  with  this  remark. 


Proposition  5 


If  F  c  G  ,  in  the  sense  that  graph  F  c  graph  G  ,  then  W(xQ,yo)  e  graph(F),  we  have 

DF(xo'yo)(uo)  c  “‘VW 


It  follows  from  the  fact  that  D  .  (x„, y„)  c  D  .  ._.  (x„ ,y„)  .  ■ 

graph  (F)  0  '0  graph(G)  0  J,0 

In  particular,  if  f(')  is  a  regularly  Gateaux-differentiable  selection  of  F(’), 
its  Gateaux-derivative  Vf(x)  is  a  selection  of  the  set-valued  map  DF(x,f(x)).  ■ 


We  note  that  the  restriction  F I  *  F  +  V  of  a  set-valued  map  F  to  a  subset  L 

I L  L 

is  contained  in  F  .  In  this  case,  we  obtain  a  more  precise  result. 


Proposition  6 


Let  F  be  a  set-valued  map  from  K  c  x  to  Y  ,  L  be  a  subset  of  K  and  f|^ 

be  the  restriction  of  F  to  L  .  Then,  for  any  £  L  and  y  e  F  (x.) , 

1  0  0  0 

<6)  "Il'WV  C  DF(X0'y0,|DL(x0)(U0)- 

In  other  words,  the  contingent  derivative  of  the  restriction  of  F  to  L  is  contained 
in  the  restriction  of  the  contingent  derivative  to  the  contingent  cone  to  L  . 


Indeed,  v^  £  DF  lL(x0>yg)  (uQ)  if  and  only  if  for  all  e  >  0  ,  for  all  a  >  0  ,  there 
exists  h  >  0  such  that 


Fj  (x  +h  u)  -  y 

v  £  u  -t-2-r - - ° 

0  II  U-UQ||  <E  h 


F(xo+h  u)  -  *0 


I  u-u0ll<e 


This  requires  that  there  exists  u  £  uQ  +  cB  such  that  x  +  hu  e  L  .  Hence  uQ  belongs 
necessarily  to  D^(Ug)  an<^  formu)-a  (6)  ensues.  • 

We  give  now  a  formula  on  the  contingent  derivative  of  the  sum  of  a  set-valued  map 

and  a  smooth  single-valued  map. 

....  •■•*••• 

Proposition  7 


Let  us  assume  that  the  set-valued  map  F  is  defined  on  K  by  F(x)  =  G(x)  +  H(x) 
where  H  is  a  continuously  differentiable  map  from  a  neighborhood  of  K  to  Y  and  G 
is  any  set-valued  map  from  K  to  Y  .  Then,  for  any  xQ  e  K  ,  zQ  £  G(xQ)  and  yQ  = 
zQ  +  H(xq)  e  F(xQ),  we  have: 

(7)  DG(xo'zoMuo)  +  7H(X0>,U0  c  DF(Vyo)(uoK 

Proof ■ 

Let  uQ e  Dom  DG(x0,y0>  be  given  and  vQ  £  DG (xQ ,yQ) (uQ) .  Since  H  is  continuously 
differentiable,  for  any  e  >  0  ,  there  exist  6  c  ]0,e]  and  a  >  0  such  that  for  all 
u  £  uQ  +  6B  and  for  all  h  <_  a  ,  H(xQ  +  hu)  =  H(xQ)  +  hVH(x0>u  +  he  ,  with  Hell  <_  e. 
Since  v  £  DG(x  ,y  )(u  ),  there  exists  u  e  u.  +  «B  and  h  <  a  such  that  v.  £ 


G(x0  +  hu)  -  zQ  F(xn+hu)-zn 

- £ -  +  eB  .  Hence  vQ  +  VH(xQ)u0  £  - - - ^  +  2eB  +  VH(xQ)  (u0-u)  e 


F(x0+hu)  -  zQ 


+  e(2  +  ll7H(x  )ll  )B. 


By  taking  G  =  t*  ,  we  obtain  the  following  corollary. 

Proposition  8 

Let  F  be  a  continuously  differentiable  map  on  a  neighborhood  of  K  and  f|  k  be 
its  restriction  to  K  .  Then 


(8) 


V  x.  €  K 


df|k(x0) <u0) 


{Vf(xq)  •  uQ}  when  uQ  e  DK(x0> 


0 


when  uQ  4  DK<X0> 


Variational  principle. 

We  generalize  to  the  case  of  set-valued  maps  the  fundamental  fact  that  the 
derivative  of  a  function  at  a  point  where  it  achieves  the  minimum  vanishes. 

Let  p  c  Y  be  a  closed  convex  cone  defining  a  preorder  on  Y  (by  calling  non¬ 
negative  elements  those  elements  of  P  ) .  Let  F  be  a  set-valued  map  from  K  c  x  to 
'i .  We  say  that  xQ  e  K  achieves  the  minimum  of  F  on  K  at  y^  ■  F(xQ)  ^ 

(9)  V  x  e  K  ,  F  (x)  c  yQ  +  P  . 


Proposition  9 

Let  us  assume*  that  xQ  t  X  achieves  *the* minimum  of  *F*  on*  K  at  yQ  .  Then*, 
(10)  V  UQ  e  X  ,  DF(x0,y0)  (uQ)  c  p 


Proof. 

Let  vQ  e  DF (x0»y0) (uq) .  For  all  e  >  0  and  a  >  0  ,  there  exists  u  e  uQ  +  cB 
such  that 


F(x  +hu)  -  y 

v  e  - - -  +  eB  <=  P  +  eB 

u  n 


by  (9).  Hence  vQ  <  ci(P)  =  P  . 
Remark . 


This  inclusion  is  trivial  when  uQ  ^  Dom  DFfx^.y^),  since  in  this  case 
DF«X0'y0)(U0)  =  *■ 

The  following  property  will  play  an  important  role  for  defining  upper  contingent 
derivatives  of  a  real-valued  function. 
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Let  P  be  a  closed  convex  cone  of  Y  .  For  any  subset  L  ,  we  set  L  =  L  *  F; 
we  say  that  L  is  "comprehensive"  if  L+  =  L  . 

Proposition  10 

Let  F  be  a  set  valued  map  from  K  to  Y  .  Then,  for  any  (x^,yQ)  e  graph  (F)  , 
we  have 

(H)  DF(X0,y0)+  c  DF+(x0,y0). 

If  the  images  of  F  are  comprehensive)  the  images  of  DF(x^,yQ)  are  also  comprehensive.  ■ 
Proof . 


Let  Vg  e  DFlx^.y^)  (u^)  and  z  e  P  .  Let  e  >  0  and  a  >  0  .  We  know  that  there 

F(x0  +  hu)  -  yQ 

exist  u  e  u_  +  eB  and  h  <  a  such  that  v.  e  - r -  +  eB.  Hence 

o  —  on 

F(xq  +  hu)  +  hz  -  yQ  F+(x  +  hu)  ”  yo 

v  +  z  e  - r -  +  eB  c  - - -  +  eB  ,  and  thus ,  v„  +  z  c 

on  n  o 


DWV(V- 


5 .  Upper  contingent  derivative  of  a  real-valued  function. 

We  associate  with  the  function  V:X  the  set-valued  map  V  defined  by 

V  (x)  =  V(x)  +  ]R  when  V(x)  <  +ro  and  V  (x)  =  0  when  V(x)=  +  '.  Its  domain  is  the 
+  +  + 

domain  of  V  and  its  graph  is  the  epigraph  of  V  .  We  consider  its  contingent  derivative 
DV+(x,V(x)),  which  has  comprehensive  values  by  Proposition  4.10.  Therefore,  for  all 
uQ  e  X  ,  DV+(x,V(x))  is  either  IR  ,  or  a  half  line  [v^,00!  ,  or  empty.  We  set 

(1)  D+V(x)(u)  =  inf  {v  |v  £  DV+  (x,V(x) )  (u)  }  . 

It  is  equal  to  if  Dv+(x,V(x))  =  IR  ,  to  vQ  if  DV+ (x,V(x) ) (u)  =  [v^,”[  and  to 

+“  if  DV+(x,v(x) )  (u)  =  V  . 

Definition  1 

We  shall  say  that  D+v(x)(u)  is  the  "upper  contingent  derivative"  of  V  at  x 
in  the  direction  u  .  ■ 


We  can  define  as  well  V  (x)  =  V(x)  -  and  D  V(x)(u)  =  sup{v,v  DV_  (x ,  V  (x) )  (u) 

We  say  that  D  V(x) (u)  is  the  lower  contingent  derivative  of  V  at  x  in  the  direction 


We  begin  by  computing  upper  contingent  derivatives. 


Theorem  1 


If  V  is  a  real-valued  function,  then 


D  V(x  ) (u  )  =  lim  inf 
0  h  +  0+ 


V  (Xq  +  hu)  -  V(xQ) 


Indeed,  let  vQ  £  DV+ (xQ ,V (xQ) ) (uQ) ;  then,  Ve1>0,e2>0,  Va>0,  there 


exist  u  £  uQ  +  £2B  and  h  <  a  such  that  vQ  £ 


V+(xQ  +  hu)  -  V(x0) 


+  e^B  .  This  implies 


V  (x  +  hu)  -  V(x  )  v*x0  +  hu*  ”  V*xo' 

that  v-  >  - - - e,  >  inf  inf  - - - c,  .  Therefore 

°“  h  1_  h<a  Hu-u0II<e2  h  1 


t 


V(xQ  +  hu)  -  Vtx  ) 

vn  i  inf  - r - e,  .  Let  us  set  for  the  time 

0  h  ^  0+  h  1 


a  =  lim  inf 
h  -*■  0+ 


V(xQ  +  hu)  -  V (xQ) 


.  » 


So,  we  have  proved  that  a  <_  D+V(x^)  ( u )  .  On  the  other  hand,  we  know  that  for  any  II  >  a  , 
there  exists  6  >  0  such  that 

V (x  +  hu)  -  Vtx  ) 

sup  inf  inf  - - - - -  <_  m  . 

a>0  h<a  II  u  — ull  <6 
6>0  0 

This  shows  that  M  >  a  ,  V6  >  0  ,  there  exist  h  <  a,  and  u  t  u^  +  SB  such  that: 

V(xQ  +  hu)  -  v(xQ) 


Hence  M  e 


V+(xQ  +  hu)  -  V (xQ) 


This  proves  that  a  e  DV+ (xQ ,V(xQ) ) (uQ) .  Since 


it  is  smaller  than  all  the  other  ones,  we  infer  that  a  =  D+V(xQ) (uQ) . 
Proposition  1 


If  the  function  V  is  locally  Lipschitzean ,  we  have 


D+V(xq) (vq)  =  lim  inf 
h  -*■  0+ 


V(xQ  +  huQ)  -  V(xQ) 


It  is  a  consequence  of  Proposition  3.2,  since  in  this  case  the  set-valued  map  V+ 

is  upper  locally  Lipschitzean.  One  can  see  it  directly  for  in  this  case, 

V(x  +  hu  )  -  V(x  )  V (x  +  hu)  -  Vtx  ) 

lim  inf  - - - - - 2-  =  lim  inf  - 2 - - - .  ■ 

h  -*•  0+  h  -*■  0+  h 

u  -  uo 

So,  in  this  case,  the  upper  contingent  derivative  coincides  with  one  of  the  Dini  derivatives. 


We  can  compute  in  the  same  way  the  lower  contingent  derivative  of  V  :  we  obtain 


D  Vtx  )  (u  )  =  lim  sup 
h  -*•  0+ 


V(xQ  +  hu)  -  V (Xq) 


I 


Therefore,  we  always  have 
(5) 

We  shall  say  that  the  interval-valued  map: 


D+V(x0)(uq)  <_  D_V(xq)  (uq)  . 


u0*  ID+V(*0)(u0).  D_V(x0)(u0] 


is  the  contingent  gap  map. 

Let  us  mention  also  that 


(6) 


D  V(x  ) (-u  )  =  lim  sup 
+  U  0  h  -*■  0+ 


V(xQ)  -  V(xQ  -  hu) 


Remark . 

Let  V  be  a  function  from  X  to  ]-»,+«>].  We  set 
(7)  K  =  {x  e  X  such  that  V(x)  <_  c  }. 

We  can  characterize  the  contingent  cone  to  K  at  x  in  the  following  way: 
Proposition  2 


If  V(x)  =  c  ,  then 

(8) 

Proof . 


Dr(x)  c  {v|d+v(x)(v)  <_  0}  . 


If  v  D  (x) ,  then  V  e  >  0,  V  a  >  0  ,  there  exist  h  <  a  and  v  r  v.  +  eB 
u  k  0 

such  that  x  +  hv  e  K  ,  i.e.,  such  that  V*x  +  hv) - Vjx)_  ^  This  implies  that 

D+V(x)(vq)  <_  0  .  ■ 

Remark . 

The  indicator  ]-“,+«]  of  a  subset  K  c  x  is  the  function  defined  by 

$K<x)  =  0  when  x  £  K  and  $R(x)  =  +“  when  x  ^  K  . 

Proposition  3 

The  upper  contingent  derivative  of  the  indicator  4>r  of  K  c  x  is  the  indicator 
of  the  contingent  cone  D^tx): 

D+Vx,(*>  -  <bK(*>(,)  • 

It  follows  from  proposition  3.1,  for  <(iK+  =  is  the  indicator  of  K  .  • 


(MU' 


6.  Calculus  on  upper  contingent  derivative 

The  upper  contingent  derivative  inherits  the  properties  of  the  contingent  derivative 
of  set-valued  maps.  In  the  above  corollaries,  we  use  the  fact  that  a  <  b  if  end  mi 
[b,“[  c  [a,»[  and  that  U  [a.,<»[  =  [min  a.,“>[  . 

i  1  i  1 

We  begin  by  the  variational  principle. 

Proposition  1 

Let  v  be  a  function  from  K  to  3R  .  If  xQ  e  K  minimizes  V  on  K  ,  then 
(1)  V  uQ  e  X  ,  0  <  D+V(x0)  (u  ) .  ■ 


We  apply  Proposition  4.9  with  F(x)  =  V+(x),  P  =  m+  and  yQ  =  V(xQ). 
Proposition  2 


Let  V  be  a  function  from  K  to  IR  and  L  c  K.  Let  v|  be  the  restriction  of 
V  to  L  .  Then 

(2)  V  xQ  e  L  ,  V  vQ  £  Dl(x0>  ,  D+V(x0)(u0)  i  D+V I L 'V  V ' 


It  follows  from  Proposition  4.6  with  F(x)  =  V+(x). 

We  estimate  now  the  upper  contingent  derivative  of  the  sum  of  two  functions. 
Proposition  3 . 

Let  V  and  W  be  two  functions  from  K  to  R  and  D  =  V  t  W.  Let  L  c  K  be 
a  subset  of  K  .  Then 

(3)  I  D+  U(V  (u0>  -  D+v(xo)  ‘V  +  D-w(xo)  (uo’ 

|ii)  V  u0  C  Dl(x0)  ,  D +V|L  <*0)  (u0)  <  D_V(x0)(u0)  . 

Therefore,  when  D+V(x^)  =  D^V(x^)  (which  is  the  case  when  V  is  convex  continuous 
or  continuously  differentiable) ,  we  obtain  the  formula 

(4)  v  uo  e  dl(x0)'  d+v1l  (xo)(uo)  =  D+v(xo)(uoK 


Inequality  (3)  i)  follows  from  the  fact  that 


lim  inf  (f(h,v)  +  g(h;v))  lim  inf  f(h,v)  +  lim  sup  g(h,v) 
h  -*■  0+  h  -*■  0+  h  -►  0+ 
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where  we  set  f(h,v) 


and  g(h,v) 


We  deduce 


I 


v 


* 


V(xQ  +  hv)  -  V(xQ) 


inequality  (3)  ii)  by  taking  for  function  W 

(4)  follows  from  (2)  and  (3)  when  D  v(x„)(u„) 

♦  00 

Remark 

We  deduce  from  Proposition  4.7  that  when 
equality 


W(Xq  +  hv)  -  W(xQ) 


the  indicator  ?L(«)  of  L  .  So,  equality 


=  D-V'W- 


W  is  continuously  differentiable,  we  have 


D+U(xq)  (uQ)  =  D+V (xQ)  tuQ)  +  <VW(xQ),u0  >  .  ■ 

We  shall  now  prove  the  chain  rule  formulas. 

Proposition  4 

Let  V  :  K  -*•  1R  be  a  function  and  be  a  continuously  differentiable  non-decreasing 
function  from  an  open  neighborhood  of  V(K)  to  1R  .  Then 

(5)  D+  WV)  (xQ)  (uQ)  <_ -P  ’  (.V  (xQ) )  D+V  (Xq)  (Vp)  ■ 

Proof . 

Since  <f  is  non-decreasing,  ^>(V+(x))  =  (<V)  +  (x).  Hence,  we  apply  Proposition  4.1: 
with  A  =  P,  F(x)  =  V+(x)  and  y  =  V(x)  .  We  obtain  ~p  '  (V  (xQ) )  DV+  (xQ ,V (xQ) )  (uQ)  c 
D(^V)  +  (xq,^V(x0))  (uq)  ,  i.e.,  (5)  . 

Proposition  5. 

Let  V  be  a  function  from  K  to  IR  and  A  a  continuously  differentiable  map  from 
an  open  subset  52  c  z  t<3  K  .  Then 

(6)  D+V(AXQ)  (VA(x0)uq)  £  D+(VA)  (xQ)  (uQ)  .  ■ 

Proof . 

We  apply  Proposition  4.2  with  F(x)  =  V+(x)  .  ■ 

The  following  formula  on  the  contingent  derivative  of  the  pointwise  minimum  of  a 
finite  number  of  real  valued-functions  is  very  useful. 

Proposition  6 


Proof . 


r  t 


We  note  that  V+(x)  s=  U  v.  (x)  and  that  I(x,V(x))  =  I(x).  We  apply  Proposition 
iel  1 

4.3. 

Proposition  7 

Let  us  consider  n  functions  V.  from  K  to  ffi .  We  set 


(8) 

Then 

(9) 

Proof . 


i)  W(x)  =  max  V.  (x) 

i 


ii)  J(xQ)=  {i  =  l,...,n  |  (xQ,  W(xQ))  ^  int  Eptvj}  . 


D  W(x  )(v)  >_  max  D  V.  (x  )  (v)  . 

i£j(X0)  +  1  ° 


A 


We  note  that  W+(x)  =  V_.  +  (x)  and  that  J(xo)  =  J(x0'w(xo"'  Then  Proposition 

4-4  implies  that  D  W  (x  ,W(x  ) ) (v)  c  n  DV.  (x„  ,W (x„) )  (v) .  This  inclusion 

ieJ(x  ,w  (x  )) 

implies  inequality  (9) .  u  u  , 


Remark 


If  x„  e  ft  Int  Dom  V.  ,  we  note  that 

0  i-1 

(10)  J(xQ)  =  U  =  |  W(xQ)  =  Vi(xQ)}  .  ■ 

We  shall  study  now  the  chain  rule  for  the  composition  of  a  function  v  from  X 
to  ®  and  an  absolutely  continuous  function  t  +  x(t).  We  recall  that  almost  all  t 

1  vh 

is  a  Lebesgue  point,  i.e.,  satisfies  x'(t„)  =  lim  -  f  u  x'(i)dT. 

°  ™  N 


Proposition  8 


Let  x(*)  be  an  absolutely  continuous  function  from  [t^-p , t^+n]  to  K  c  x  and 


assume  that 
(11) 


l  tn+h 

x' (t  )  =  lim  —  /  x'(t)dT  . 
0  .  ^  h  * 

h+0+  tQ 


(This  limit  belongs  to  D  (x(t  )).) 

K  0 

Set  v(t)  =  V(x(t)).  Inequality 


(12) 

always  holds  true . 


v(t  +h)  -  v(t  ) 

D  V  (jc  (t  ) )  (x ' (t  ) )  <  lim  sup  - — - - 2- 

+  °  °  ~  h  +  0+  h 
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Moreover,  if  V  is  the  restriction  to  K  of  a  locally  Lipschitzean  function  V 
defined  on  a  neighborhood  of  K  ,  then 


(13) 


v(t  +h)  -  v(t  ) 

lim  inf  - - -  <_  D+V  (x (tQ) )  (x1  (tQ) )  . 

h  -*■  0+ 


v(tQ+h)  -  V(tQ) 

Therefore,  if  we  know  that  v' (t  )  =  lim  - - -  exists,  we  get 

0  h-K)+  h 


(14) 
Proof . 


v'  (tQ)  =  D+V(x(t  ))  (x 1  <t  ))  . 


)  .  We  set  v  =  i  /b  x'  (x)dT .  So,  we  can  associate  to  any  e  >  0  a  positive 


h  h 


number  8  >  0  such  that 

(15)  V  h  <  8,  II v.  -  x'  (t  ) II  <  e. 

—  h  0  — 

We  observe  that  x(t  +  h)  =  x(t  )  +  h  v  e  K  .  Hence  x' (t  )  e  D  (x(t  )).  We  set 
0  On  0  K  0 


v^(tQ)  =  inf  sup 
a>0  h<a 


v(tQ  +  h)  -  v(tQ) 


We  have 


D  V(x(t  ))  (x1  (t  ))  =  lim  inf 
h  -*■  0+ 


V (x (tQ)  +  h  v)  -  V(x(tQ)) 


<_  sup  inf  sup  inf 
E  >0  a>0  h<a  vev^+eB 


V(x(tQ)  +  hv)  -  V(x(tQ)) 


V(x(tQ)  +  hvh>  -  V(x(tQ)) 

<  sup  inf  sup  - - — r -  =  v’  (t  )  . 

“  e>0  a>0  h<ot  h  #  0 

v(t  +  h)  -  V(t  ) 

b)  .  Let  v' (t  )  =  lim  inf  - r -  '  Then,  for  all  e  >  0  ,  there 

b  0  h  -  0+  h 

v(t  +  h)  -  v(t  ) 

exists  v  >  0  such  that,  V  h  <  y,  v'  (t  )  <  - - - —  +  c  .  Let  i  be  the 

—  b  0  —  h 

Lipschitz  constant  of  V  at  x(t^).  Then,  for  all  v  e  x'  (tQ)  +  eB  and  h  <_  a  = 

min(B,y),  we  have,  thanks  to  (15) 

V(x(tQ)  +  hvh)  -  V(x(t  ))  V (x ( t  )  +  hv)  -  V (x (t  ) ) 

v- (t0)  <  - h -  +  E  ^ - — h - —  +  2l£  • 


On  the  other  hand,  we  know  that  there  exists  h  <_  a  and  v  e  x'  (tQ)  +  eB  such  that 
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V(x(t  )  +  hv)  -  V  (x  (t  ) 

- jj - D+V  (x  (t^) )  (x‘  (tQ) )  +  £  .  Hence 

vb(V  1  D+V(x(t0))  (x- (tQ) )  +  (2U1)  e. 

By  letting  e  -*•  0  ,  we  obtain  v'(t  )  <  D  V(x(t  )  (x'  (t  ) )  .  since  x’(t  )  D  (x  (t  } )  , 

b  0  —  +  0  0  OK. 

proposition  2  implies  that  D+V  (x  (tQ) )  (x  ■  (tQ) )  <_  D+V  (x  (tQ) )  (x1  (t  ) )  .  Hence  (11)  holds 
true.  ■ 

Remark . 

If  both  V  and  x  are  locally  Lipschitzean ,  then  v  is  also  locally  Lipschitzean 

and  inequality  (13)  can  be  written,  by  setting  D  v(t„)  =  D  v(t  ) (1)  , 

+  0  +0 

<16>  D+v(tQ)  <_  D+V(x(tQ)  )  (X'  (tQ)  )  .  ■ 

We  can  "integrate”  inequalities  involving  contingent  derivatives. 

Proposition  9. 

Let  v  be  a  continuous  function  from  [0,T]  to  1R  and  w  be  a  bounded  upper  semi- 

continuous  function  from  10, T[  to  IR  which  is  bounded  above.  We  assume  that 

d7>  V  t  £  [0 ,T (  ,  D+v(t)  +  w (t )  <_  0  . 

Then,  for  all  0<^a<b<T,we  obtain  the  inequality 

(18)  v(b)  -  v(a)  +  I*3  w(t)dx  <_  0  ■ 

a 

Proof. 

b  £  [a ,b]  and  e  >  0  be  fixed.  Since  w  is  upper  semicontinuous ,  there 
exists  n  £  ]0,£  [  such  that,  V  h  <_  n  , 

(18)  Jt+h  w(t)di  <  w(t)  +  e/2 

and  there  exists  <_  n  and  at  such  that  | a  —1 1  <_  e  that  satisfy 

v ( t  +  ha)  -  v  (t)  .  ,  % 

(20)  - JLb -  <  Um  inf  vfetha I  -  v(t)  +  _ 

ht  h  -  0+  h 

Hence  t  belongs  to  the  subset  a  1 

•  s+h 

(21)  N(t)  =  {s  e  [a,b]  |v(s+htat)  -  v(s)  +  /  w(T)dx  <  eh  } 

s  t 

which  is  open  since  v  is  continuous .  Let  us  set 

m  =  sup  w(t)  <  +®  . 
t£  [a,  b] 
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Hence  the  compact  interval  [a,b]  can  be  covered  by  n  open  subsets  Mt^).  .\e 


set  a.  =  a.  ,  h.  =  h  and  =  mm  h.  >  0  . 
1  t.  1  t.  0  .  ,  i 

l  l  i=l,. ..,n 


We  construct  by  induction  the  following  sequence.  We  set  ~  -  a;  it  belongs  tc 


N (t .  )  and  thus,  by  taking  s  =  i  (=a)  and  t  =  h.  a.  ,  we  obtain 
1  0  1  1X  lx 

T  hiai+a 

vd^)  -  v(tq)  +  /  w(x)dT  <_  ehx  +  /  w(T)dr. 


Assume  that  for  j  <  k  ,  we  have  constructed  a  sequence 


ta,b[  (1  <  j  k: 


such  that 


T.  h-a'+Ti-l 

(t.)  -  v(x.  ,)  +  /  ^  w(t)dT  <  eh.  +  f  J  ^  ’  w(-r)dT 

3  3-1  1  -  3  L  ... 


hj+Tj-l 


Then  t.  belongs  to  some  N(t.  )  ;  we  set 
*  ^+1 


=  x,  and  t.  ,  =  T.  +  h.  a. 

k  k+1  k  i,  ,  i,  , 

k+1  k+1 


and  we  deduce  that 


h.  ai  +Tk_1 

(24)  v(t.  ,)  -  v(x.)  +  /  k+1  w (x) dt  <_  eh.  +  /  k+1  k+1  w(i)dT  . 

\  k+1  hiv  ;vi 

k+1 

If  x,  <  b  <  t,  ,  ,  we  stop  the  construction.  Otherwise,  we  continue.  Since  T  .  - 
k  —  k+1  k+i 

a  h  >  h  >  0  ,  we  are  sure  that  eventually,  after  a  finite  number  of  steps,  we 

i,  ,  i.  ,  —  0/2 

k+1  k+1 

shall  have  an  index  k  such  that  <  b  <  Tk+1  * 

By  adding  the  above  inequalities  from  j  =  1  to  k  ,  we  obtain 

Tk+1  k+1 

(25)  v(t,  ,)  -  v(a)  +  /  w(f)dT  <  ef  7  h.l  m'  where  m'  is  a  constant. 

k+1  1  —  K.L.  i' 

a  i=l 

When  e  converges  to  0  ,  and  converge  to  b  (for  Tjc+^  ~  Tk  = 

h.  a  <_  nd+e)  <_  e  (1+e))  and  thus,  we  deduce  that 
1k+i  K 

v(b)  -  v(a)  +  /  w(T)dx  0  .  • 

a 

In  particular,  we  obtain  the  following  useful  consequence. 

Proposition  10 

Let  v  be  a  continuous  function  from  [0,T]  to  IR  satisfying 


(24)  V  t  e  ] 0 , V [  ,  D+v(t)  £0  . 

Then  the  function  v  is  non -increasing. 


7. 

Let  us  consider  a  family  of  minimization  problems  depending  upon  a  parameter  y: 
Minimize  the  function  x  *»  U(x,y)  on  a  subset  Fly).  We  define  the  marginal  function 
V  by 

(D  V(y)  =  inf  U(x,y) 

xtF (y) 

and  the  marginal  map  G  by 

<2>  G(y)  =  {x  £  Fly)  |  U(x,y)  =  V  (y) }  . 

Sensibility  analysis  deals  with  the  behavior  of  the  marginal  functions  V  and  the  marginal 
G  when  the  parameter  y  varies  around  a  fixed  value  y^ .  This  is  of  upmost  relevance 
in  economics,  for  instance,  as  well  as  in  other  fields.  In  the  convex  case,  we  refer  to 
Rockafellar  [1).  In  the  locally  Lipschitzean  case,  to  Aubin-Clarke  [3]  and  to  Aubin  14). 

We  shall  study  in  this  section  the  properties  of  the  contingent  derivatives  of  the  marginal 
function  V  and  the  marginal  map  G  . 

For  simplicity,  we  assume  that 

i)  F  is  a  compact-valued  map  from  a  subset  M  of  a  Hilbert  space  7 
(3)  to  a  Hilbert  space  X 

ii)  V  y  e  M  ,  x  -*■  U(x,y)  is  lower  semicontinuous . 

Hence  the  marginal  map  G  is  well  defined  on  M  . 


Contingent  derivatives  of  marginal  functions  and  marginal  map 


Proposition 


Let  yQ  -  K  and  xQ  e  G(yQ)  achieve  the  minimum  of  U(’,yQ)  on  F(y0>.  Then, 
(4)  V  vQ  £  Dorn  DF(y0,x0),  v  uQ  £  DF  (yQ  ,xQ)  <vQ)  ,  D+V<y0Hv0>  I  D_U (xQ ,yQ)  <uQ ,vQ) . 
Furthermore, 


(5)  v  v0  £  Dorn  DG(y0,x0),  v  u0  £  DG  (y0,xQ)  <vQ)  ,  D+U  lxQ  ,yQ)  (uQ  ,vQ)  <  D_V  (y0>  (vQ>  .  • 

Proof . 


a).  Let  uQ  e  Df  (yQ,x0) (vQ) .  Then,  for  all  e  >  0  ,  a  >  0,  there  exist  h  <  a, 
v  £  Vq  +  eB,  u  e  uQ  +  eB  such  that  x^  +  hu  £  F (y^  +  hv) ,  and  therefore,  such  that 
V(y0  +  hv)  <  l)(x0  +  hu,  yQ  +  hv)  .  Since  V(yQ)  =  Ulx0,yQ),  we  deduce  that 

V(yQ  +  hu)  -  V(yQ)  U(xQ  +  hu,  yQ  +  hv)  -  U(xn,yn) 

h  -  h  • 

This  implies  inequality  (4) . 
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b) .  Let  uQ  e  00 (yo'X0>  <V0) ■  Then'  for  a11  E  >  0  ,  a  >  0,  there  exist  h  <  a, 
v  £  vQ  +  eB  ,  u  £  uQ  +  eB  such  that  x^  +  hu  e  G(y3  +  hv) .  Hence  V(y3  *  hv)  = 

U  (X0  +  +  hv)  .  Since  Vly^)  =  ^xo'^0^'  we  ^e!^uce  bhat 

U(x3  +  hu,  y0  +  hv)  -  U(x0,y0)  V  (yQ  +  hu)  -  V(yQ) 


This  implies  inequality  (5). 


8 .  Ekeland's  variational  principle 

We  shall  derive  the  approximate  variational  principle  of  Ekeland  in  the  foil 

form: 

Theorem  1 

Let  K  c  X  be  a  closed  subset  of  a  Hilbert  space  and  V:K  -  [0,  [  be  a  lower 

semicontinuous  function.  Then  we  can  associate  with  any  £  >  0  and  an-’  x 

2 

satisfying  V(x  )  <  inf  V(x)  +  £  an  element  x  e.  K  which  satisfies 

I  E_  xeK 

i)  II  x  -  x  II  <  £ 

(1)|  e  e  - 

ii)  v  u  e  X  ,  0  <_  D+V(x£)  (u)  +  dull.  • 

Proof ■ 

We  derive  this  result  from  Ekeland's  variational  principle  (see  Ekeland  (1)  or 
Aubin  [1],  p.  174.) 

Theorem  (Ekeland) 

Let  K  be  a  closed  subset  of  a  Hilbert  space  and  V  be  a  lower  semicontinuous 

function  from  K  to  [0,°°[  .  Then  we  can  associate  with  any  £  >  0  and  any  x  K 

2  -  - 
satisfying  V  (x  )  <_  inf  V(x)  +  £  an  element  xeK  which  satisfies  ii  x  -  x 

E  X£K 

and  v(x  )  =  min  (V(x)  +  ellx  -  x  II]  .  ■ 

f  xeK  £ 

Let  u  e  Dom  D+V  (x^) .  Then,  for  any  g  >  0  ,  i  >  0  ,  a  >  0  ,  3h 
3  v  e  u  +  6B  such  that 

V  (x  +  hv)  -  V(x  ) 

- - - r - —  <  D  V  (x  )  (u)  +  n  . 

h  —  +  £ 

By  Ekland's  variational  principle,  we  have 

V  (x_  +  h  v)  -  V(x  ) 

-eS  -  dull  <  -dvll  <  - - - - - - — 

—  —  h 

Therefore,  we  infer  that 

0  <_  D^V (x^l  (u)  +  ellull  +  £  6+n 

By  letting  6  and  r)  converge  to  0  ,  we  obtain  the  desired  inequality. 
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9 .  Surjectivity  theorems. 

We  devote  this  section  to  the  generalization  to  the  case  of  upper  semicontinuous 
maps  with  compact  values  of  the  inverse  function  theorem.  We  shall  begin  by  proving 
theorems  of  existence  of  stationary  points ,  then  deduce  surjectivity  theorems  and  we 
shall  end  with  a  theorem  insuring  that  the  image  by  F  of  a  neighborhood  of  x  is  a 
neighborhood  of  F(x).  These  theorems,  due  to  Ekeland,  are  simple  consequences  of  his 
variational  principle. 

It  is  convenient  to  start  with  the  following  lemma. 


Lemma  1 

Let  G  be  a  set-valued  map  from  K  c  x  to  Ley  and  V  be  a  continuous 
convex  function  defined  on  a  neighborhood  of  L  .  We  define  the  set-valued  map  H  -  V(G) 
from  K  to  1R  by 

(1)  V  X  e  K  ,  H(x>  =  {v(y)}yeG(x)  ■ 

Assume  that 


(2) 


axQ  £  K  ,  3yQ  £  G(xq)  and  aQ  £  IR  such  that 


V  x  £  K  ,  H(x)  C  V  (yQ)  +  aQll  x  -  XQII  +  . 

Let  DV(y)(*)  denote  the  derivative  of  V  at  y  .  Then 
(3)  V  u0  £  X  ,  V  v0  £  DG(x0,y0)  <u0>,  a0llu0ll  <  DV(y0)  (vQ> 

Proof ■ 

Let  vQ  £  DG(xQ,y0)  (uQ)  .  Hence,  for  all  a,B,y  >  0  ,  there  exist  h  <_  a, 

u  £  u  +  yB  such  that 

G(xq  +  hu  )  -  y„ 


+  6  B 


So,  we  can  write  y^  +  hv^  =  y^  +  Bhb  where  y^  £  G(Xg+hu)  and  b  £  B  . 

Since  V  is  convex,  we  deduce  that 
(4)  V(yh)  -  V(yh  -  hvQ)  <  h  DV(yh)  (vQ) 

and  since  v  is  continuous  (and  thus,  locally  Lipschitzean)  ,  there  exists  £.  >  0 
such  that 


V(yh  -  hvQ)  -  V  (yQ)  HI  yh  -  yQ  -  hvQll  1  l  B  h  . 
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We  recall  that  y  t»  DV(y)(vQ)  is  upper  semicontinuous .  Then  for  all  e  >  0  , 

3n  >  0  such  that 

(6)  DV(y^)(vQ)  <_  DV(y^)(v0)  +  r  when  II  y^  -  yQll  n. 

By  taking  a  <_  n/(B  +  llv^ll)  if  necessary,  inequalities  (4),  (5)  and  (6)  imply  that 
V(Yh>  -  V(yQ)  <_  h  (DV  (yQ)  (Vp)  +  r  +  16) 

or, 

HCx  +  hu  )  -  V (y  ) 

DV(y  )  (v  )  f  - -■ - -  +  ffi  +  (e  +  1B)B  . 

u  u  n  + 

We  use  now  assumption  (2):  we  obtain 

DV(yQ)  <vQ)  e  aQllu  II  +  (e  +  1B>B  +  ]R+  . 

By  letting  e,B  and  Y  go  to  0  ,  we  infer  that 

DVV(V  -  aolluo"- 

When  L  is  a  subset  of  X  ,  we  set 

m(L)  =  lx  '  L  such  that  llxll  =  min  llyll). 

yf  L 

Theorem  1 

Let  F  be  an  upper  semi  continuous  map  with  compact  values  from  a  compact  subset 
K  of  a  Hilbert  space  X  to  a  Hilbert  space  Y  .  We  assume  that 

<7)  VxeK,  3  y  e  m(F(x)),  3U  f  X  such  that  -y  c  DF(x,y)(u)  . 

Then  there  exists  a  stationary  point  x  e  K  of  F  .  • 

Proof . 

Since  the  function  x  *■  II  m  (F  (x) ) II  is  lower  semicontinuous  (for  F  is  upper  semi- 

continuous  with  compact  values)  and  since  K  is  compact,  there  exists  x^  e  K  which 

achieves  the  minimum  of  x  -*•  llm(F(x)l|  on  K  .  Let  us  choose  yQ  e  m(F(x0>).  We 

set  v(x)  =  llxll  and  H(x)  =  { V (y )  }  .  .  .  It  is  clear  that 

yeF(x) 


VxeK, 

H (x)  c  V(yQ)  +  ®+ 

since,  if  c  e 

H (x) ,  then 

c  >  II  m  (F  <x)  )||  >  II  m  (F  (x  ) )  II  *  V(y  ). 

—  —  0  J  0 

So,  we  apply  Lemma  1 

with  aQ  *  0  . 

We  deduce 

that 

V  u0  E  X  , 

V  vQ  c  DF(x0,y0)(u0), 

0  <  DV  (yQ)  (vQ)  , 

By  assumption 

(7) ,  we  can 

take  Vg  =  _7o'  s^nce 
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DV(y  )  (-y  )  =  lim 
h-*0+ 


11  y0  -  hyQll  -  llyoll 


we  deduce  that  lly^ll  0  .  Hence  =  0  e  F(x^).  ■ 

Corollary  1 

Let  F  be  a  Gateaux  differentiable  continuous  map  from  a  neighborhood  of  a  compact 
subset  K  to  Y  .  Assume  that 

(8)  V  x  K  ,  gu  c  D^tx)  such  that  VF(x)u  =  -F(x). 

Then  there  exists  a  stationary  point  xQ  c  K  of  F  .  ■ 

By  using  Ekeland's  theorem,  we  can  replace  the  compactness  assumption  on  K  in 
Theorem  1  by  another  assumption  on  the  growth  of  the  inverse  of  the  contingent  derative. 
Theorem  2  (Ekeland) 

Let  F  be  an  upper  semicontinuous  map  with  compact  values  from  a  closed  subset  K 
of  a  Hilbert  space  X  to  a  Hilbert  space  Y  .  We  assume  that 

f 

I  gc  >  0  such  that,  V  x  K  ,  3y  m(F(x)),  3u  e  7 

(9) 

'  such  that  -y  DF(x,y)(u)  and  ell  u)i  <_J)y)J  . 

Then  there  exists  a  stationary  point  x  K  of  F  .  ■ 


By  Ekeland's  theorem,  we  can  associate  with  any  e  <  c  an  element  x^  t  K 
such  that,  for  all  x  K  , 

(10)  II m  (F  (xQ ) )  II  <_  llm(F(x);il  +  dlx  -  xQll  . 

If  m(F(Xg))  =  yQ  =  0  ,  the  theorem  is  proved,  otherwise  we  take  V(x)  =  llxll  and 

H(x)  =  { V (y ) >  .  .  Inequality  (10)  can  be  written 

y  •  F (x) 

(11)  V  x  K  ,  H(x)  c  V  (yQ)  -  dlx  -  xQ||  +  TR+  . 

Hence  we  apply  Lemma  1  with  aQ  =  -e  .  We  obtain:  V  u^  c  x  ,  V  v^  e  DFlx^y^)  * 
-cIIUqII  DV(yQ)(v^).  By  assumption  (9),  we  can  take  vQ  =  -yQ  and  uQ  c  X  satisfying 

cIIUqII  II  yQll  .  Since  DV(yQ)(-y0)  =  -llyoll,  we  obtain  the  contradiction  -cllu^ll  <_ 

-II  yQll  -ell  uQll  .  So  yQ  =  0  .  • 
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Corollary  2 


Let  F  be  a  Gateaux-dif ferentiable  continuous  map  from  a  neighborhood  of  a  close: 
subset  K  c  x  to  Y  .  Assume  that 


(12) 


3c  >  0  such  that,  VxeK,  au  -r  D  (x)  such  that 
VF(x)u  =  -F(x)  and  cllull  <  llF(x)ll. 


then  there  exists  a  stationary  point  x^  e  K  of  F  .  ■ 

In  particular,  we  can  take  K  =  X  .  We  obtain  :  -■ 

Corollary  3 

Let  F  be  a  Gateaux-dif ferentiable  continuous  map  from  X  to  Y  .  Assume  that 
3c  >  0  such  that,  V  x  e  X  ,  3U  e  X  satisfying 
I VF  (x) u  =  -F  (x)  and  cllull  <  II F  (x) II  . 


(13) 


Then  there  exists  a  stationary  point  xQ  of  F  .  • 

By  replacing  the  set-valued  map  F  by  G(x)  =  F(x)  -  y  ,  we  obtain  solutions  to 
the  inclusion  y  e  F(x).  Therefore,  we  obtain  the  following  surjectivity  theorems. 
Theorem  3 

Let  F  be  an  upper  semicontinuous  map  with  compact  values  from  a  closed  subset 
K  of  a  Hilbert  space  X  to  a  Hilbert  space  Y  .  We  assume  that 
3c  >  0  such  that,  VxeK,  V  y  e  F (x)  ,  VveY, 

(14) 

|3u  e  X  satisfying  v  e  DF(x,y)(u)  and  cllull  <_  llvll  . 

Then  for  all  y  e  Y  ,  there  exists  a  solution  x  e  K  to  the  inclusion  y  £  F(x)  ■ 

In  other  words,  F (K)  =  Y  .  Theorem  3  says  that  F  is  a  surjective  set-valued  map. 

For  smooth  single-valued  maps,  we  obtain  the  following  Corollaries. 

Corollary  4 

Let  F  be  a  Gateaux-dif ferentiable  continuous  map  from  a  neighborhood  of  a  closed 
subset  K  C  X  to  Y  .  Assume  that 


(15) 


3c  >  0  such  that,  VxeK,  VveY,  3ueD(x) 

K 


satisfying  VF(x)(u)  =v  and  cllull  <_  llvll  . 
Then  F(K)  -  Y  . 
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Corollary  5 


Let  F  be  a  Gateaux-dif f erentiable  continuous  map  from  X  to  Y  .  Assume  that 

(3  c  >  0  such  that,  V  x  e  X  ,  V  v  e  Y  ,  3  u  e  X  satisfying 

VF(x)u  =  v  and  cllull  £  IJvll  .  ■ 

Then  F  is  surjective. 

We  prove  now  an  adaptation  of  the  inverse  function  theorem. 

Theorem  4  (Ekeland) 

Let  F  be  an  upper  semicontinuous  map  with  compact  values  from  a  neighborhood  L' 
of  x  €  x  to  Y  .  We  assume  that 

3  c  >  0  such  that  V  x  e  u  ,  V  y  «  F(x)  , 

(17)  •  VveY,  aueX  satisfying 

DF(x,y)(u)  =  v  and  cllull  ^_llvll  . 

Then  F(U)  is  a  neighborhood  of  F(x).  ■ 

Proof 

Let  U  contain  a  closed  ball  of  center  x  and  radius  n  >  0  and  let  y  e  F(x)  . 

We  claim  that  F (x  +  nB)  contains  the  balls  y  +  cB  with  c  <  c  n  • 

Indeed,  pick  yx  «  y  +  eB  and  set  G(x)  =  F(x)  -  yx  .  We  apply  Ekeland 's  theorem 
in  the  stronger  form  to  the  function  lim(F(x)  -  y^)ll,  taking  e  as  above.  Noting  that 
llm(F(x)  -  y1>ll  <_  e  ,  we  get  some  point  x^  such  that 

i)  llx  -  xll  <_  n 

(18)  '  _! 

ii)  ¥  x  e  x  +  nB,  llm(F(xQ)  -  y  II  <_  II  m  (F  (x)  -  y^jll  +  eg  llx  -  xQll  . 

Take  yQ  e  m(F(xQ)  -  y^)  .  Either  it  is  zero  (and  y^  f  F(xQ))  or  Viy^)  ~  llm(F(Xg)  -  y^)ll 

5  0  .  In  this  case  we  obtain  a  contradiction.  Indeed,  inequality  (18)  ii)  implies  that 
V  x  (  K  ,  H(x)  c  V(y0>  -  en  1  llx  -  x()ll  +  IR+  (where  H(x)  =  V(G(x)).) 


10.  The  Newton  method 


We  proved  in  Corollary  9.1  that  when  F  is  a  continuously  differentiable  map  f  r 


K  c  IF;  to  1R  that  satisfies  the  condition 


then  there  exists  a  stationary  point  K  of  F 


These  assumptions  imply  also  that  there  exist  trajectories  x(«)  of  the  differential 


inclusion 


that  remain  in  K  and  that  converge  to  a  stationary  point  of  F  when  t 


Haddad  [1 ]  . ) 


We  can  consider  such  trajectories  as  the  continuous  analogs  of  the  classical 


Newton  method,  which  yields  the  discrete  trajectory  defined  recursively  by 


Theorem  1 


Let  F  be  a  continuously  differentiable  map  from  a  neighborhood  of  a  closed  subset 


Then  there  exists  a  viable  trajectory  of  the  implicit  differential  equation  (2)  that 


Thus  the  cluster  points  of  x(t)  (if  any)  are  stationary  points  of  F 


Trajectories  of  the  differential  inclusion  x'  n(x) 


are  the  trajectories  of  the  implicit  differential  equation  (2)  .  Assumptions  of  Haddad's  thooi 


(See  Haddad  [11]  on  differential  inclusions  are  satisfied.  Hence  there  exists  viable 


trajectories  of  the  implicit  differential  equation  (2) .  Consider  any  such  trajectory 


Then,  since  F  is  continuously  differentiable,  we  have 


So  y(t)  =  F(x(t))  is  equal  to  e  y(0).  Therefore,  F(x(t))  converges  to  0  when 


t  -*•  00  .  Any  cluster  point  x.  e  K  ,  limit  of  a  subsequence  x(t  )  when  t  -*■  00  , 

*  n  n 

satisfies  Fix.)  =  lira  F(x(t  ))  =0  ,  and  thus,  is  a  stationary  point  of  F  .  ■ 

*  n 

Recall  that  the  above  sufficient  condition  for  existence  of  a  stationary  point  of 
F  can  be  extended  to  set-valued  maps  (see  Theorem  9.1):  We  replace  the  tangential  condi¬ 
tion  (4)  by 


(5)  V  x  €  K  ,  ay  e  F  (x)  ,  3u  e  X  such  that  -y  e  DF(x,y)(u) 

where  DF(x,y)  is  the  contingent  derivative  of  the  set-valued  map  F  . 

We  can  generalize  the  Newton  method  if  we  assume,  for  instance,  that 
f  there  exists  a  bounded  upper  hemicontinuous  proper  set-valued  map  G 
|  from  graph  (F)  to  the  closed  convex  subsets  of  ]pn  such  that 

V  x  e  K  ,  V  y  f  F  (x)  ,  au  (  G(x,y)  such  that  -y  e  DF(x,y)(u)  . 

I 

Theorem  2  (Saint-Pierre) 

Let  F  be  a  proper  map  from  K  c  to  ]pm  with  closed  graph.  We  posit 

Assumption  (6).  Then,  for  any  xQ  £  K  and  yQ  e  F(xQ>,  there  exists  a  solution  to  the 
differential  inclusion 


that  satisfies 


x1  (t)  e  G(x(t)  ,  e  y  ) 


V  t  >_  0  ,  x(t)  e  K  and  e  y^  e  F(x(t)) 


Thus  the  cluster  points  of  x(t)  (if  any)  are  stationary  points  of  F  . 


We  consider  the  differential  inclusion 

(9)  x'  e  G(x,y)  ,  y'  =  -y 

with  the  initial  condition  x(0)  =  xQ,  y(0)  =  y  . 

Condition  (6)  implies  that 

(10)  V  (x,y)  e  graph (F),  (G(x,y),-y)  n  Dgraph (F)  <x>y)  ?  0  • 

Then  Haddad's  theorem  (See  Haddad  [1])  implies  that  there  exists  a  trajectory 
(x(t) ,y(t) )  of  this  differential  inclusion  which  remains  in  graph  (F) .  Furthermore, 
y(t)  =  e  fcy0.  Hence  e  tyQ  e  F(x(t)).  The  rest  of  the  theorem  ensues. 
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Remark . 


We  note  that  we  can  devise  a  whole  family 


point  of  F  •  Let  H  be  any  map  from  3R  to 

ui) 


the  solution  of  y'  =  H(y),  y(0)  =  yQ  is 


of  algorithms  that 
itself  such  that 
unique  and 


converge 


converges  to  0  ,  when  t  -*■  00  . 

We  associate  with  such  a  map  H  a  bounded  continuous  map  G  (single-valued 
of  simplicity)  such  that 

(12)  V  (x,y)  e  graph (F),  H(y)  €  DF (x ,y) (G (x ,y) ) . 

Then  there  exist  solutions  to  the  differential  equation 

(13)  x' (t)  e  G  (x  (t)  ,y  (t) )  ,  y ' (t)  =  H(y(t)),  x(0)  =  xQ  ,  y(0)  =  yQ 


to  a  stationary 


for  the  sake 


such  that 


(14)  V  t  >_  0  , 

Since  lim  y(t)  =  0 

t  -►  00 

points  of  F  . 


y(t)  e  F  (x  (t) )  . 

by  assumption,  the  cluster  points  of 


x(t)  (if  any)  are  stationar 
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11 .  Liapunov  functions  and  existence  of  stationary  points  . 


We  shall  use  the  existence  of  Liapunov  function  which  we  define  below  for  proving 
the  existence  of  stationary  points.  In  the  next  sections,  we  shall  prove  that  the  exist¬ 
ence  of  these  Liapunov  functions  imply  also  that  solutions  to  the  associated  differential 
inclusion  do  converge  in  some  sense  to  stationary  points  of  F  when  t  0  . 

We  begin  with  a  particular  case,  which  is  a  "stationary  point"  version  of  the 
Aubin-Siegel  fixed  point  theorem,  which  is  an  extension  to  the  case  of  set-valued  maps  of 
the  Caristi  fixed  point  theorem  (See  Aubin-Siegel  [1],  Brdzis-Browder  [1]  and  Caristi  [1]). 
Theorem  1 

Let  K  be  a  closed  subset  of  the  Hilbert  space  X  ,  F:K  ■*  X  be  a  set-valued  map 
and  V:K  ■*  [0,“[  be  a  lower  semicontinuous  function  satisfying 
(1)  V  x  t  K  ,  3v  £  Fix)  such  that  d+V(x)(v)  +  II  vll  <_  0  . 

Then  there  exists  a  stationary  point  x  e  K  of  F  .  ■ 

Proof . 

Take  e  <  1  and  x  c  K  satisfying,  thanks  to  Theorem  7.1, 

Vu  ex,  0  <  D  V  (x  )  (u)  +  ellull  . 

—  +  e 

By  assumption,  we  can  take  u  e  F(x  )  satisfying  D+V(x  )  (u)  _  -  Hull.  Hence 
(1  -  ejllull  <  0  ,  i.e.,  u  =  0  e  F(x  ). 

—  E 

Remark ■ 

This  theorem  can  be  regarded  as  the  "stationary  point"  version  of  the  "Caristi 's 
fixed  point  theorem". 

Theorem  2  (Caristi) 

Let  K  be  a  closed  subset,  g:K  -*•  K  be  a  single-value  map  and  V  be  a  lower 
semicontinuous  map  from  K  to  K+.  If 

V  x  c  K  ,  V(g(x))  -  V(x)  +  llg(x)  -  xll  ^  0  , 

then  g  has  a  fixed  point.  ■ 

So,  we  have  proved  that  if  there  exists  a  lower  semicontinuous  function  V  such 
that  D+V(x)(v)  +  II vll  <_  0  for  all  x  e  K  ,  there  exist  a  stationary  point.  The  question 
arises  whether  existence  of  stationary  points  implies  the  existence  of  a  function  V 
satisfying  the  above  condition. 


Theorem  3  (Moreau) 


T.et  K  be  a  closed  subset  and  F  be  a  set-valued  map  from  K  to  X  satisfying 

(2)  -  F  is  monotone  (V  x,y  e  K  ,  V  u  e  F  (x)  ,  V  v  e  F  (y)  ,  <  u  -  v,x  -  y  >  <_  0  ) 

We  assume  that  the  set  f  1 (0)  of  stationary  points  of  F  has  a  non-empty  interior.  Let 

-1  1 
us  associate  with  any  t  Int  F  (0)  the  function  V  defined  by  V(x)  =  —  II  x  -  xll 

0  2p  0 

where  p  =  d  (xQ ,(  F_1  (0) )  >  0  .  Then 

(3)  V  x  e  K  ,  V  v  £  F(x)  ,  DV  (x)  (v)  +  II  vll  0  . 

and,  consequently,  for  any  x  c  xQ  +  p  Int  B  ,  F(x)  =  {0}  .  ■ 

Proof . 

Let  us  take  x  K  and  v  •  F(x).  Since  ■+  :>B  F  1  (0)  ,  then  x_  -  V~rr  is 

0  0  !!  vll 

a  stationary  point  of  F  .  The  monotonicity  of  -F  implies  that 

(4)  < v,  x  -  x_>  +  (•!!  vll  =  <v-0,  x-x  +  >  0  . 

0  0  llvli  — 

Let  x  =  x^  +  pu  c  x  +  .  Int  B,  and  v  F(x)  .  We  infer  that  ,  <  v,u  >  ♦  .  II  v" 

Hence  llvli  <_  II  vll  Hull  <  llvli  ,  which  is  impossible  when  v  ^  0  .  ■ 

We  may  generalize  Theorem  1  by  introducing  the  concept  of  Liapunov  function  with 
respect  to  a  set-valued  map  F  and  a  given  function  W  defined  on  graph  (k ) 

Definition  1 

Let  F  be  a  set-valued  map  from  K  •  X  to  X  and  W  be  a  function  defined  on 
graph  (F) .  We  shall  say  that  the  function  V  defined  on  K  is  a  Liapunov  function  for 
F  with  respect  to  W  if  it  satisfies  the  following  "Liapunov  property" 

(5)  V  X  c  K  ,  3v  f  F  (x)  such  that  D^V(x)(v)  +  W(x,v)  <_  0  . 

When  W  =  0,  we  say  simply  that  V  is  a  Liapunov  function  for  F  .  ■ 

Theorem  4 . 

Let  F  bo  a  set-valued  map  from  a  closed  subset  K  r-  X  to  X  ,  W  be  a  non¬ 
negative  function  from  graph  (f)  to  JR  and  V  be  a  lower  semicontinuous  function  fi 
K  to  JP+  .  Assume  that  V  is  a  Liapunov  function  for  F  with  respect  to  W  .  Then, 

(6)  V  e  >  0  ,  3  x  K  and  v  '  F(x  )  satisfying  W(x  ,v  )  <_  »'Hv  Jl  . 

If  we  assume  moreover  that  v  is  lower  semicompact  (this  means  that  for  all  x 
the  subsets  {x  •  K  jv(x)  A}  are  relatively  compact),  then 
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(7) 


3  X*  €  K  , 


a  V,  e  F(x„)  such  that  Wtx^.v,,)  =  0  . 


Proof ■ 

a) .  We  apply  Ekeland's  variational  principle:  V  e  >  0  ,  3X_  e  K  such  that, 

2 

¥  v  e  X  ,  0  <_  D+V(x  )  (v)  +  ellvll  .  Since  V  is  a  Liapunov  function  with  respect  to  W, 

there  exists  v  c  F(x  )  such  that  D  V(x  ) (v  )  <  -W(x  ,v  ).  Hence  property  (6)  holds  true. 

£  £  +££—££ 

b)  .  When  V  is  also  lower  semicompact,  there  exists  xt  e  K  that  achieves  the 
minimum  of  V.  So  VveX,  0  <_  D+V(xt)  (v)  by  the  variational  principle.  Since  V 
is  a  Liapunov  function,  we  choose  v„  €  F(x4)  such  that  D+V (x,)  (vt)  ^.-W(x4,vt).  ■ 

So,  Theorem  1  is  the  particular  case  when  W(x,v)  =  II  vll  .  By  taking  W(x,v)  =  llvll  , 
a  >  1  ,  we  obtain  the  existence  of  approximate  stationary  points: 

Corollary  1 

Let  F  be  a  set-valued  map  from  a  closed  subset  K  c  x  to  X  and  V  be  a  lower 
semicontinuous  Liapunov  function  for  F  with  respect  to  II  •lla,  a  >  1  .  Then, 

(8)  V  e  >  0  ,  ax  f.  K  such  that  F(x^)  n  eB  ^  0.  ■ 

Note  also  that  when  W  satisfies  the  condition 

(9)  V  x  e  K  ,  V  v  ?  0  ,  W  (x,v)  >  0 
we  obtain  the  existence  of  stationary  points. 

Corollary  2 

Let  F  be  a  set-valued  map  from  a  closed  subset  K  c  x  to  X  ,  W:graph(F)  ■*  3R+ 
be  a  nonnegative  function  satisfying  property  (9)  and  V  be  a  lower  semicontinuous  and 
lower  semicompact  liapunov  function  for  F  with  respect  to  W  .  Then  there  exists  a 
stationary  point  x„  e  K  of  F  .  ■ 

Remarks 

We  shall  prove  that  in  this  case,  under  some  supplementary  continuity  assumptions, 
solutions  to  the  differential  inclusion  x1  e  F(x),  x(0)  =  xQ,  converge  to  a  stationary 
point  of  F  in  some  sense  when  t  -*•  °°.  Note  that  the  tangential  condition 

(10)  V  x  e  K  ,  F(x)  n  Dk<x)  ?  $ 

are  involved  in  the  Liapunov  condition  (5) ,  since  the  domain  of  the  upper  contingent 
derivative  D+V(x)(*)  is  contained  in  the  contingent  cone  DR(x)  to  the  domain  K  of 
V  :  Indeed,  if  V  is  a  Liapunov  function,  there  exist  v  e  F(x)  such  that 


condition  (10)  holds  true 


Actually,  if  we  take  V  =  $  the  indicator  of  K  ,  defined  by 


the  Liapunov  condition  can  be  written 


°°  when  x 


We  mention  also  that  when  K  is  convex  and  compact  and  when  F  is  upper  hemicon 


tinuous  with  closed  convex  values,  the  Browder  -  Ky  Fan  theorem  states  that  the  tangential 


condition  (10)  is  sufficient  for  establishing  the  existence  of  a  stationary  point  x^  V 


of  F  (See  for  instance  Aubin  [3] ,  Chapter  15) 


Exanmle 


By  taking  for  V  (x)  the  restriction  to  K  of  x  -*•  i  II  x-x 


we  obtain  the  following 


corollary,  after  noticing  that 


when  v  e 


Let  K  be  a  weakly  closed  subset  of  X  and  W  be  a  function  from  X  to  [0 


that  is  strictly  positive  when  v  ^  0  .  Let  a  set-valued  map  F  from  K  to  X  and 


av  e  F(x)  n  D  (x)  such  that  < x-x  ,v  >  -  W(v)  <  0 


Then  the  best  approximations  of  x  by  elements  of  K  are  stationary  points  of  F 


As  a  particular  case,  we  obtain  the  following  result.  Let  F  denote  the  inverse 


of  F  and  a(F  (v),p)  =  sup{(p,x  >  |  x  e  F  (v)  }  denote  the  support  function  of  F  (v) 


Let  K  be  a  weakly  closed  subset  of  X  and  F:K  •»  X  be  a  set-valued  map  satisfying 


Then  the  best  approximations  of  x  by  elements  of  K  are  stationary  points  of  F 


Proof . 


We  apply  Corollary  3  when  W  is  defined  by 

f  W(v)  =  (x  ,  v  )  -  0(  F  1  (v)  ,v)  when  v  e  F(K),  V  /  0 

10 

W(0)  =  0 

'  W(v)  =  +°°  when  v  |  F(K)  and  v  /  0  . 

Then  for  any  v  <r  F(x),  we  deduce  that  <  x,v  >  o(F  1  (v)  ,v)  since  x  e  F  1(v). 
Therefore 

<  X  -  xQ(v  >  <_  o  (F-1  (v)  ,v)  -  <  xQ,v  >  <_  -W  (v)  . 
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12.  Monotone  trajectories  of  a  differential  inclusion 


Let  K  and  L  be  subsets  of  X  =  IRn  .  Let  V:K  +  ®  and  W:K  *  1  E  be  two 

+ 

given  functions  and  F:K  ■*  X  be  a  set-valued  map. 

Definition  1 

We  say  that  a  trajectory  x(*)  of  the  differential  inclusion 

(1)  x'  (t )  e  F  (x  (t) )  ;  x  (0)  =  xQ 

is  monotone  (with  respect  to  V  and  W)  if 

(2)  V  s  >  t  >  0  ,  V(x(s))  -  V(x(t))  +  /S  W(x(T)  ,  x'  (T))dT  <  0  .  ■ 

t 

Note  that  this  condition  implicitely  implies  that 

(3)  V  t  _>  0  ,  x(t)  e  K  (i.e.,  x  ( * )  is  "viable") 

since  V  is  defined  on  K  . 

Proposition  1 

If  W:K  XL-*  1R+  is  nonnegative,  then 

(4)  t  ■»  V(x(t))  decreases  and  converges  to  ■  -  lim  V(x(t)) 

t  *« 

and 

(5)  /  w(x(t),  x'([))dr  =  lim  JtW(x(i),  x'(T)Jdr)  <  +”>  .  ■ 

0  t  ♦  <o  o 

Remark 

& 

Note  that  (4)  implies  that  when  V  is  lower  semicontinuous ,  all  the  cluster  points 
x„  of  the  trajectory  when  t  -*  <»  (if  any)  satisfy  a  =  V(xt).  ■ 

Proof ■ 

The  first  statement  is  obvious. 

Also,  since 

fs  w(x(t)  ,x' (t)  )dx  £V(x(t))  -  v  (x  (0) )  -*■  a-a  =  0 
t 

when  t,s  -*■  the  Cauchy  criterion  implies  that  when  W  is  nonnegative 

/”  W(x(i),x'(T))dT  =  lim  W(x(x)  ,x' (T))dT  <  +“> 

0  t  •+ »  0 

(where  the  integral  is  a  Riemann  improper  integral).  ■ 

We  shall  see  in  Section  14  that  this  latter  condition  implies  that  W(x(t)  ,x'(t) ) 
converges  to  0  in  some  sense  when  t  ■»  «. 
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According  to  the  assumptions  relating  V  and  W  ,  monotonicity  property  (2) 
yields  useful  informations  on  the  behavior  of  the  trajectory. 

Example  Trajectories  with  finite  length  .  Let  us  consider  the  case  where 
(6)  W(x,u)  =  II vl(  . 

Theorem  1 

The  trajectories  x(#)  on  [0,°°[  that  are  monotone  with  respect  to  V  and 

W :  ( x ,  v )  *>  llvll  have  finite  length  /  II  x  •  (t  )  II  <3  r  and  converge  to  x^  c  K  when  t  *•  rx>. 

0 

If  K  is  closed  and  F  is  upper  semicontinuous  with  compact  convex  values,  then  x# 
is  a  stationary  point  of  F  .  ■ 

Proof . 

By  (5),  J  II  x '  ( T )  II  dl  ,  which  is  the  length  of  the  trajectory,  is  finite.  Further- 
0 

more,  inequality 

llx(t)  -  x  (s )  II  <_  /S  II  x'  (l)lldl  ->  0  when  t,s  -*  °° 
t 

and  the  Cauchy  criterion  imply  that  lim  x(t)  =  xa  does  exist.  The  following  theorem 

t  -►  oo 

shows  that  xA  is  a  stationary  point. 

Theorem  2. 

Let  F  be  an  upper  semicontinuous  map  from  a  closed  subset  K  c  x  to  X  with 
compact  convex  values  and  x(*)  be  a  trajectory  of  the  differential  inclusion  (1)  that 
converges  to  some  x*  c  K  .  Then  x*  is  a  stationary  point  of  F  a 

Proof 

Assume  that  0  <j  F(xA)  :  there  exists  c  >  0  such  that 


(7) 

f.  B  n  +  e  B)  =  0 

(for 

F(xJ 

is  a  closed  subset) •  Since  f 

is 

upper  semicontinuous, 

there  exists 

ft  >  0 

such 

that  F(y)  c  F(x^)  +  L  B  whenever 

II  y  -  xjl  <  6  .  Hence 

there  exists 

T  >  0 

such 

that,  V  t  ^  T  ,  llx(t)  -  x^ll  < 

&  . 

Consequently : 

(8) 

V 

t  >_  T  ,  F (x (t) )  c  F(x„)  +  c  B  . 

Since 

x '  (t) 

r  F (x (t) )  for  almost  all  t  > 

0  , 

the  mean  value  theorem  implies  that  for 

all 

t  >_  T 
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(9) 


x(t)  -  x  (T) 


/*  x'(T)dicc3(F(x,)  +  EB)  =  F(xt)  +  EB 


since  F(x„)  +  e  B  is  closed  and  convex.  Therefore,  statements  (7)  and  (9)  imply 


that  V  t  >  T, 

xt  =  1 im  x (t ) . 

t-f  » 


x  (t )  -  x  (T) 
t  -  T 


>  E  ,  which  is  a  contradiction  of  the  fact  that 


Example. 

He  shall  illustrate  the  importance  of  monotone  trajectories  by  the  following  th- or  :  . 
Theorem  3 

Let  yj  be  a  continuous  bounded  function  from  [0,°°[  to  1R  and  let  W(x,v)  * 
y5  (V  (x) )  .  Let  x  be  a  trajectory  satisfying  property  (2)  and  w(«)  be  a  solution  to 
the  differential  equation 

(10)  w'  (t)  +  *  (w(t) )  =  0  V  t  >  0  ,  w  (0)  =  V  (x  (0) )  . 

Then,  we  obtain  the  following  estimate: 

(11)  V  t  >_  0  ,  V  (X  (t ) )  £w(t).  ■ 

This  statement  is  an  obvious  consequence  of  the  following  Theorem,  of  which  we 

give  a  proof  due  to  H.  Antosiewicz. 

Theorem  4 

Let  !!  c  B  be  an  open  interval  and  T  +"  .  We  consider  a  function  y5  from 
[0,T[  »  ft  to  1R  satisfying  the  following  properties. 

i)  V  t  e  [0  ,T  [  ,  x  yp(t,x)  is  continuous 

(12)  j  ii)  v  x  e  ft  ,  t  (t ,x)  is  measurable 
iii)  3  a  e  L1(0,T)  such  that,  V  (t,x)  e  [0,T[  x  ft,  |*(t,x)|  <_a(t). 

Let  v  :  10,T[  ■*  U  be  a  continuous  function  satisfying 

(13)  V  s  >  t  ,  v(s)  -  v(t)  +  /S  (t ,v(t)  )dx  <_  0 

t 

Then, there  exists  a  maximal  interval  IOjT^I  such  that  the  differential  equation 
w1  +  •f  (w)  =0  ,  w(0)  =  v(0)  has  at  least  one  solution  w  on  [O.T^J  satisfying 

(14)  V  t  >  0  ,  v (t)  <  w (t)  .  • 


-52- 


Proof . 


i  1 


a) .  We  introduce  the  subsets 

/ 

K  =  {  (t,x)  [0,T[  x  ft  such  that  x  >_  v(t) ; 


L  =  {  (t,x)  t  [0,T[  x  ft  such  that  x  <_  v(t)  -  . 


Since  K  u  L  -  [0,T[  *  ft  and  K  n  L  =  { (t,x)  j  x  =  v(t):,  we  can  lefine  a  f 
on  [0  ,T  [  x  ft  by 

v’Ct.x)  if  x  >_  v(t)  (i.e.,  if  (t,x)  K) 

(15)  V  (t,x)  =  • 

( t,v(t))  if  x  <_  v(t)  (i.e.,  if  (t,x)  e  L)  . 

b)  .  The  function  y  inherits  the  properties  of  •f  .  To  see  this,  we  associate 
with  any  t  c  [0,T[  the  subsets 

K(t)  =  {x  £  ft  |  x^v(tl),  L (t)  ={x  e  ft  |  x^v(t)}. 

They  are  closed  and  cover  ft  .  Thus,  when  K(t)  0  0  (resp.  L(t)  /  0),  the  restric¬ 
tion  of  f(t,-)  to  K (t )  (resp.,  to  L(t))  is  continuous.  Hence  we  conclude  that 
for  all  t  £  [0,T[  ,  x  h-  f(t,x)  is  continuous.  Similarly,  we  introduce  the  subsets: 

K(x)  =  {t  £  [0,T[  |  x  >_  v(t) }  and  L(x)  =  {t  e  [0,T[  |  x  <_  v(t) }  . 

Hence,  when  K(x)  f  0  (resp.  L(x)  0  0),  the  restriction  of  y(-,x)  to  K(x)  (resp. 

L (x) )  is  measurable.  Consequently,  for  all  x  £  ft  ,  the  function  t  -*  1!l(t,x)  is 
measurable.  Obviously,  |¥(t,x)|  £a(t)  for  all  (t,x)  £  (0,T(  x  ft. 

cl  We  choose  now  TQ  <  T  such  that  the  set  of  points  (t,x)  £  [0,TQ]  x  ir 

satisfying  |x-x  |  <_  a(x)dT  is  contained  in  [0,T[  x  ft  .  Then,  by  Caratheodory ' s 

0 

theorem,  there  exists  at  least  a  solution  w(*):[0,T^]  -*•  ft  to  the  differential  equatir. 

(16)  w'  (t)  +  ¥  (t,w(t) )  =  0  t  w (0)  =  v (0)  . 

d) .  We  assert  that  for  all  t  £  (0,T^),  v(t)  <^w(t).  If  not,  there  would  exist 
t2  e  ] 0 ,Tq]  such  that  v(t2>  >  w(t2>.  Let  t^  =  inf{s  £  [0,TQ]|v(t)  >  w(t)  for  all 


Since  v(s)  >  w(s)  ,  we  deduce  that  ij<(s,w(s))  =  f  (s,»(s))  for  all  s  e  ]t^,t_J. 
Hence 

t 

wft^)  =  v(t^)  -  /  v>(s,v(s))ds  . 

fcl 

By  assumption  (13),  we  deduce  that  w(t^)  ^v(t^)  (because  t^  t^)  .  This  contra 
diets  inequality  v(t2)  >  w(t?).  Hence  v(t)  ^w(t)  on  [0,Tj.  ■ 


13.  Almost  convergence  of  monotone  trajectories  to  stationary  points 


We  recall  that  when  a  Liapunov  function  V  for  F  (with  respect  to  //)  satisfif- 


(1)  V  is  lower  semicontinuous  and  lower  semicompact 


So,  when  the  function  W 


the  existence  of  a  Liapunov  function  V  for  F  with  respect  to  W  and  assumptions 


(1)  and  (3)  imply  the  existence  of  stationary  points 


do  satisfy  the  property  (2)  (In  this  case,  property  (3)  guarantees  that  such 


cluster  points  x*  of  x(t)  are  stationary  points  of  F] 


We  already  noted  that  when  W(x,v) 


which  is  a  stationary  point  by  Theorem  11.2.  The  proof  of  this  theorem 


limit  x. 


does  not  yield  the  fact  that  cluster  points  of  x(t)  are  stationary  points 


A  difficulty  arises  right  now:  the  derivative  x' (t)  is  only  defined  almost  every¬ 


where.  So  we  shall  use  an  adaptation  proposed  by  A.  Cellina  of  the  concepts  of  limit 


and  cluster  points  for  measurable  functions  to  prove  that  measurable  functions  taking 


their  values  in  a  compact  subset  do  have  such  "almost"  cluster  points  and  that  "almost 


cluster  points"  x*  and  v*  of  x(t)  and  x* (t)  satisfy  W(x*,v^)  when  x(*)  is 


monotone  trajectory  with  respect  to  V  and  w 


Definition  1 


Let  x  :  [0,°°[  -►  X  be  a  measurable  function  and  xw  e  X.  We  say  that  x^  is  the 


almost  limit  of  x(»)  when  t  ■+  «>  (and  we  write  x, 


3T  >  0  such  that  g { t  e  [T 


We  say  that  x*  is  an  almost  cluster  point  of  x(t)  when  t  »  if 


These  concepts  are  justified  by  the  following  theorem: 

Theorem  1 

Let  F  be  an  upper  semicontinuous  map  from  K  u  iRn  to  the  compact  subsets  of 
]Rn  ,  W  be  a  nonnegative  lower  semicontinuous  function  defined  on  graph  (F)  and  V 
be  a  nonnegative  lower  semicontinuous  and  lower  semicompact  function  defined  on  K  . 

For  any  monotone  trajectory  x(t)  of  F  with  respect  to  V  and  W  ,  the  functions 
x(t)  and  x' (t)  have  almost  cluster  points  xt  and  v„  which  satisfy 
(6)  x„  e  K  ,  v*  £  F(x*)  and  Wtx^v*)  =  0  . 

If  W  satisfies  the  condition 

(3)  V  x  £  K  ,  V  v  /  0  ,  W(x,v)  >  0 

then  such  an  almost  cluster  point  x„  is  a  stationary  point.  ■ 

The  proof  of  this  theorem  will  be  obtained  by  tying  up  the  following  properties 
of  almost  convergence.  For  simplicity,  we  restrict  our  study  to  the  case  of  functions 
of  a  real  variable.  Adaptation  for  functions  defined  on  a  measured  space  is  quite  easy. 

We  begin  by  showing  that  the  usual  concepts  of  limit  and  cluster  point  are  partic¬ 
ular  cases  of  almost  limit  and  almost  cluster  point. 

Proposition  1 . 

Any  limit  of  x,  of  x  (•):  [0  ,”[->•  X  is  an  almost  limit  point.  If  x  ( - )  is 
uniformly  continuous,  any  cluster  point  xt  of  x ( • )  is  an  almost  cluster  point.  ■ 
Proof ■ 

a)  To  say  that  x„  =  lim  x(t)  amounts  to  saying  that  Ve>0,  3  T>0  such 

t  ■*  00 

that  n  { 1 1  Jlx(t)  -  xjl  e}  =  {3  .  Hence  the  measure  of  this  set  is  equal  to  0  . 

b)  Let  x*  be  a  cluster  point  of  x ( • ) s  Since  x(*)  is  uniformly  continuous, 

there  exists  n  such  that  |  s-t  |  implies  llx(t)  -  x(s)ll  <_  c/2.  Also,  there  exists 

a  sequence  t  -*•  °°  (which  satisfies  t  -  t  >  2q)  such  that  llx4-x(t  )ll  <  e/2 
n  n+1  n  —  *  n  — 

when  n  >  N  .  So,  for  any  n  >  N  ,  the  disjoint  intervals  [t  -  n,  t  +  n  ]  are 
t  e  n  n 

contained  in  {t  e  (0,»[  |llx(t)  -  xjl  <_  e}  .  Hence 

"  =  w<  u  It  -  n,t  +nl)  <_  u({t  e  [*,«■>[  |llx(t)  -  xjl  <  e)  .  ■ 

n>N 
—  e 
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The  following  example  justifies  the  introduction  of  the  concept  of  almost  cluster  point. 
Proposition  2 . 

If  W  is  a  nonnegative  function  belonging  to  i/tO,"),  then  0  is  an  almost 
cluster  point  of  w  when  t  -»  °°  .  ■ 

Proof . 

If  not,  there  exists  e  >  0  such  that  the  measure  of  A^  =  {t  c  (0,<°[jw(t)  <_  e} 
is  finite.  Hence  the  measure  of  £  A^  =  {t  e  [0,“[|w(t)  >  e}  is  infinite.  Therefore: 


/  w(t)dT  >_  /  w(t)dT  +  /  w(i)dT  e  u(Ja  )  = 

C\ 


which  is  a  contradiction. 

Proposition  3 

An  almost  limit  x„  of  a  measurable  function  x(  •):  [0  ,“[-*■  X  is  the  unique  almost 
cluster  point.  ■ 

Proof . 


Let  be  an  almost  cluster  point  different  from  xt .  We  choose  c  <  II  xt  -  yt  /2 

and  T  such  that  the  subset  K  =  {t  e  [T,°°(  |llx(t)  -  xjl  >_  e}  has  a  measure  equal  to  0. 

The  subset  L  =  {t  e  [T,°°  [  |ll  x(t)  -  y ^11  <_  e}  is  obviously  contained  in  K  and  has 
an  infinite  measure  for  yt  is  an  almost  cluster  point.  Hence  “  =  u  (I.)  <_  y  (K)  =0  , 
which  is  impossible.  So,  x,  =  y,  .  ■ 

Proposition  4 

Let  f  be  a  continuous  (single  valued)  map  from  X  to  Y  and  x(,):l0,”'[  •  X 
be  a  measurable  function.  If  xt  is  the  almost  limit  (resp.  an  almost  cluster  point) 
of  x(‘),  then  f(x„)  is  the  almost  limit  (resp.  an  almost  cluster  point)  of  f(x(-)) . 


Proof .  It  is  left  as  an  exercise.  ■ 

Theorem  2  (Cellina) 

Let  K  be  a  compact  subspace  of  X  and  x(*):[0,«[  K  be  a  measurable  function. 
There  exists  an  almost  cluster  point  x„  e  K  of  x(*)  when  t  •+  ».  ■ 
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TO 


-  4 


Proof. 

We  define  inductively  decreasing  sequences  of  measurable  sets  "y  [0,'[  and 

of  closed  subsets  E  c:  K  such  that 
n 

(7)  A  =  x  1  (E  ) ,  p(A  )  =  diam(E  )  <  1/n  . 

n  n  n  n  — 

For  n  =  1  ,  we  cover  the  compact  set  K  with  a  finite  number  of  sets  of 

diameter  at  most  1  .  Thus  the  subsets  x  ^(B^)  cover  (0,™[  and,  consequently,  one 
of  them,  denoted  A^  ,  has  an  infinite  measure.  We  set  E^  the  corresponding  set  . 

Having  defined  the  subsets  and  E^  up  to  n  ',  we  cover  the  compact  set  E^ 

by  a  finite  number  of  closed  subsets  Bn+^  of  diameter  at  most  1/n+l. 

j 

Their  preimages  x  ^(b”)  form  a  finite  covering  of  A^  .  Since  p(An)  =  "  > 

at  least  one  of  these  sets,  denoted  A  ,  ,  has  an  infinite  measure.  Call  E  ,  the 

n+1  n+1 

corresponding  B.  .  Hence  n  E  =  {x.}  .  It  remains  to  show  that  x.  is  an 
3  n>p  n  *  * 

almost  cluster  point.  Fix  e  >  0  and  T  >  0  .  Then,  a  neighborhood  N  (x.)  con- 

E  * 

tains  the  subsets  E  for  n  >  n(e).  Consequently,  x  ^ (N  (x. ))  o  x  ^{E  )  =  A  for 
n  —  c  n  n 

all  n  >_nQ(E).  Hence, 

p{t  r  [0,“t  |  x  (t)  £  N  (xt)}  >  u,  (A  )  =  °°.  ■ 

e  —in 

Proposition  5 

Let  w  be  a  nonnegative  lower  semicontinuous  from  Lex  to  JR  .  If  x(*)  is 
a  measurable  function  from  (0,»(  to  L  such  that 

(8)  J"  W (x ( t) ) di  <  +», 

0 

then  any  almost  cluster  point  xt  of  x(t)  when  t  -*■  «°  satisfies  the  equation 
W(x„)  -  0  .  ■ 

Proof. 

Let  xt  be  an  almost  cluster  point  of  x(*)  when  t  •+  “  and  assume  that 
W(X.)  >  0  .  We  take  t  =  W(x4)/2  >  0  .  Since  W  is  lower  semicontinuous,  there  exists 


[0,”[  |  llx(t)  -  x,ll  £  n)»  whose  measure  is  infinite,  is  contained  in  the  set 
B£  =  (t  £  [0,«[|w(x,)/2  £W(x(t))}.  Hence 


/  W(x(x))dT  >  f  W(x(t))dT  >  W  y(B  )  = 

0  ~k  -  2 

e 

This  is  a  contradiction.  ■ 

We  are  ready  to  prove  Theorem  1. 

Proof  of  Theorem  1 

Since  V  is  lower  semicontinuous  and  lower  semicompact,  then  x(t)  remains  in  the 
compact  subset  Q  =  (xeK|v(x)  ^.V(x^)}.  Because  F  is  upper  continuous  with  compact 
values,  the  set 


=  {  (x,v)  e  TR1  *  IRn  |  x  €  Q  ,  v  €  F(x)} 

which  is  the  graph  of  the  restriction  f|^  of  F  to  Q  ,  is  compact.  Hence  the  function 
t  -►  (x(t),x'(t))  is  a  measurable  function  taking  its  values  in  the  compact  set  F  . 


By  Theorem  2,  there  exists  an  almost  cluster  point  e.  F ^  .  Since  x(*)  is  a 

monotone  trajectory  with  respect  to  V  and  W  ,  we  know  that  f  W(x(x)  ,x' (t)  )dx  <  +°°. 

0 

Hence  Proposition  5  implies  that  W(x*,vA)  =  0  .  ■ 
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14 .  Necessary  condition  for  the  existence  of  monotone  trajectories 

We  shall  prove  that  the  existence  of  monotone  trajectories  with  respect  to  V  and 
W  of  the  differential  inclusion  x*  e  F(x),  x(0)  =  x^  for  all  initial  value  xQ  e  K 
implies  that  V  is  a  Liapunov  function  for  F  with  respect  to  W  . 

Theorem  1 

Let  F  be  an  upper  semicontinuous  map  from  K  c  ]Rn  to  3Rn  with  compact  convex 
values.  Let  W  be  a  lower  semicontinuous  nonnegative  function  on  K  <  coF(K)  which  is 
convex  with  respect  to  v  .  We  assume  that  for  all  x^  e  K  ,  there  exist  T  >  0 
and  a  trajectory  xt*)  on  [0,T[  of  the  differential  inclusion  x*  e  F  (x) ,  x(0)  =  x^ 

satisfying 

(1)  Vs  >t  ,  V(x(s))  -  V(x(t))  +  /S  W(x(T),x'(T))dT<.0  . 

t 

Then,  V  is  a  Liapunov  function  for  F  with  respect  to  W  : 

(2)  V  x  e  K  ,  a  V  e  F(x)  such  that  D+V(x)  (v)  +  W(x,v)  <_  0  .  ■ 

Proof. 


It  is  analogous  to  the  proof  of  Haddad's  Proposition.  Since  F  is  upper  semi¬ 


continuous,  we  can  associate  to  e  >  0  an  n  >  0  such  that,  for  all  tin,  F (x ( r ) ) 

x(h)  -  x 

— r - -  —  /  x'  (tMt  and 


c  F(xQ)  +  e  b,  which  is  compact  and  convex.  Since 


0 


since,  for  almost  all  t  ,  x'  (t)  belongs  to  F(x  )  +  eB,  the  mean-value  theorem 
x(h)  -  x  0 

implies  that  - - -  belongs  to  this  compact  subset. 


x(h  _)  -  x„ 


Hence  there  exists  a  subsequence  h  ■*  0  such  that  v  = 

n  n 

some  vQ  in  F(xQ)  +  eB. 


converges  to 


Since  this  inclusion  holds  true  for  all  e  >  0  ,  we  deduce  that  v^  e  f(x^). 

We  also  observe  that  x„  +  h  v  =  x(h  )  belongs  to  K  ,  the  domain  of  V  . 

0  n  n  n 

Hence  property  (1)  implies  that 

V  (x  +  h  V  )  -  v(x  )  ,  h 

(3)  - /n  W(x(t)  ,x'  (t)  )dT  0  . 

n  1  n  0 

Let  us  assume  for  a  while  that  the  following  properties  hold  true: 

Proposition  1 

Let  W  be  a  lower  semicontinuous  function  on  K  »  L  which  is  convex  with  respect 

00 

to  v  £  L.  Let  x  £  C(0,T;K)  and  v  £  L  (0,T,M)  be  given,  where  M  is  compact.  Let 


v(t)dt 


Then 


Before  proving  Proposition  1,  we  need  the  following  result  of  Ekeland  -  Temam  [1] 


When  M  is  a  subset  of  X 


function  v  (»  W(x,v)  and  by 


Proposition  2 


Let  K  and  L  be  two  nonempty  subsets  of  X  and  W:K  *  L  +  K  satisfy 


Then,  for  any  compact  convex  subset  M  c  L  ,  the  restriction  W  (x,-)  of  v  -*■  W(x,v) 


x  -*■  Epw  (x,*)  is  upper  semicontinuous  with  closed  convex  values 


To  say  that  x  -*■ 


continuous,  we  can  associate  to  each  v  e  M  an 


such  that 


Since  M  is  compact,  it  is  covered  by  a  finite  number  p  of  balls  v.  +  n  B 


Let  n  "  min  p  .  Hence  for  all  x  e  x  +  pB  ,  for  all  v  £  M  ,  there 
i«l,...,p  vi 

exists  such  that  II v  -  vj  <_  nv  £  £  satisfying  WfXg.v^)  <_  W(x,v)  +  e  . 

i 

Since  v  -*■  W  (x,v)  is  convex  and  continuous,  then  EPW(x,*)  is  closed  and  convex.  ■ 

M 

We  are  now  ready  to  prove  Proposition  1 . 

Proof  of  Proposition  1 

By  Proposition  2,  x  +  EPW  (x,*)  is  upper  semicontinuous .  Then  there  exists  h 

M  £ 

such  that,  for  all  t  £  [0,h  )  ,  EPW(x(t),-)  c  EpW„(x„,*)  +  £<B*B).  Therefore,  for 

£  MO 

all  r  £  10, h]  ,  ( v  (  t  )  ,  w(x(t)  ,v(t))  )  f  EPW  (x(t),*)  c  EPW„(x„,*)  +  e(B*B).  Hence, 

t  M  M  0 

by  the  mean-value  theorem,  we  deduce  that,  for  all  h  <  h  , 

n  —  e 

1  h  h 

(8)  (  r—  /  n  v(r)dr  ,  —  /  n  W(x(t),  v(T))dr  £  co(E  p  w„  (x„ ,  * )  +  e  (B»B) )  . 

no  n  0  M  0 

Therefore,  by  taking  the  limit,  we  obtain: 

1  h  — 

(9)  (v  ,  lim  inf  —  /  n  W (x (r)  ,v  (r) ) dr )  £  co(Ep  W  (x„,  •)  +  e(B>b)). 

h  -*■  0  n  0  M  0 

n 

Since  this  is  true  for  all  £  >  0  and  since  EpW^(x  ,•)  is  dosed  and  convex,  we  get 


1 

W(x  ,v  )  <_  lim  inf  /  n  W(x(t)  ,v(t)  )dr. 


h  -►  0 
n 


15 .  Sufficient  conditions  for  the  existence  of  monotone  trajectories. 

We  shall  prove  that,  conversely,  if  V  is  a  Liapunov  function  for  F  with 
respect  to  W  there  exist  monotone  trajectories  of  the  differential  inclusion  x 
that  are  monotone  with  respect  to  V  and  w  . 

Theorem  1 

Let  K  be  a  closed  subset  of  lRn  and  F  be  an  upper  set-valued  map  from 
the  nonempty  compact  convex  subsets  of  IRn  .  Let  W  be  a  function  defined  on 
K  x  co  F(K)  satisfying 

[  i)  W  is  nonnegative  and  continuous 


(1) 


€ 


K 


F  (x) 


to 


^  ii)  V  x  £  K  ,  v  ->  W(x,v)  is  convex. 

Let  v  :  K  -*■  1R+  be  a  Liapunov  function  with  respect  to  F  and  W  : 

(2)  V  x  £  K  ,  3V  £  F(x)  such  that  D+  V(x)(v)  +  W(x,v)  <_  0  . 

We  also  assume  that 

(3)  V  is  continuous  (for  the  topology  induced  on  K) . 

Then,  for  every  e  K  ,  there  exist  T  >  0  and  a  monotone  trajectory  x ( * )  on 
[0,TI  of  the  differential  inclusion  x'  £  f(x)  and  x(0)  =  xQ  . 

If  F  (K)  is  bounded,  then  we  can  take  T  =  °°.  ■ 


Proof . 

It  is  analogous  to  the  proof  of  Haddad's  theorem  (See  Haddad  [1]).  Since  K 

is  locally  compact,  there  exist  r  >  0  such  that  K  «  K  n  (x^  +  rB)  is  compact. 

We  set  T  =  r/  (II F  (KQ )  II  +  1)  .  If  F  (K)  is  bounded,  we  take  T  arbitrary  and  we  set 

Kq  =  K  ncllx^  +  T  F(K)  +  B)  ,  which  is  compact. 

Let  us  take  y  £  K  and  v^  £  F(y)  satisfying 

(4)  D  V (y)  (v  )  +  W(y,v  )  <  0  . 

+  y  y  — 

This  is  possible  thanks  to  assumption  (2) . 
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TTr«>H 


' 


N(y)  =  x  t  K 


Since  the  function  V  is  continuous,  the  sets  N(y)  are  open  and  y  c  N(y).  So  we  can 

find  a  bail  of  radius  a £  )0,  i  ]  such  that  (y  +  a  B)  n  K  c  N(y). 

Since  KQ  is  compact,  it  can  be  covered  by  q  such  balls  y.  +  a  B.  We 

•  •  •  •  J 

set  a.=a  ,h=h  ,  u.=u  and  v.  =  v  .  Let  us  take  now  any  x  e  K  . 

j  j  j  i  y .  0 

It  belongs  to  a  ball  y^  +  a^B  for  some  j  =  l,...,q  .  Then  there  exists  u^ 


such  that 


(  ii)  llx  -  y^ll  <_  ctj  <_  i  ,  llu..  -  v^ll  <  I  . 

Let  =  min  h.  >  0  .  So,  cancelling  the  index  j  ,  we  have  proved  that 

j«l . .  3  In 

for  all  x  e  Kg  ,  there  exist  h  e  thQ  (k) ,  £•]  and  u  t  IK  satisfying  the  two 

following  properties 

i)  3  y  £  K  and  v  £  F(y)  such  that  llx  -  yll  <_  £  ,  llu  -  vll  <_  ^ 

(9) 

ii)  -V-^+-h  ^  -  V-(-x)-  +  w(y.v)<i  . 

Therefore,  we  can  construct  inductively  a  sequence  of  elements  x  e  K  ,  v  e  F  ty 

In  p  P  P 

hp  £  [hp  (k) ,  —  )  and  up  e  3R  satisfying 

i)  x  =  x  +  h  u  e  K 

p+1  p  p  p  0 


Mr  t  r  r  — 

ii)  (xp,up)  £  (yp,vp)  +  i-  (B»B)  c  graph (F)  +  i-(BxB) 


We  are  sure  that  there  exists  an  integer  m  such  that 

h_  +  h  +  . . .  +  h  <  T  <  h  +  . . .  +  h  +  h 
0  1  m  —  1  m  m+1 

for  h  e  [h  (k)  ,  7-  ]  for  all  p  . 
p  0  k 

Let  us  set  xq  =  h  +  . . .  +  h  .  We  interpolate  this  sequence  by  the  piecewise 
k  0  q 

linear  function  x^(«)  defined  on  each  interval  ]  xP  \  xp  [  by  xk<t)  =  Xj,-i  + 


(t  -  if  1)u 


denote  by  y  (•)  and  v  (•)  the  step  functions  defined  on  this 


interval  by  yk<t)  =  Vp  an<*  vk^^  ~  Vp  ’ 

When  t  is  fixed  in  ]xp-:L,xp[  ,  we  have  |t-xp|  £  1/k  and  there  exists 

K  K  X 

(y  ,v  )  e  graph  (F)  such  that  II  x ' (t)  -  v  II  =  llu  -  v  II  <  1/k  and  llx  (t)  -  y  II  < 
p  P  kppp—  Kp  — 

II  x.  (t)  -  x  II  +  llx  -  y  II  <  It  -  t£|  (llu  -  v  II  +  II V  II)  +  II  x  -  y  II  <  1/k  (II F  (K  )ll  +  2). 

k  p  P  P  “  k  p  p  p  p  p  —  0 

By  setting  F(t,x)  =  F  (x)  ,  we  have  proved  that  V  t  >_  0  , 

(11)  (t,xk(t),  x^(t))  £  (t,yk(t)  ,vk(t))  +  c  (k)  (BxB*B)  C  graph  (F)  +  e  (k)  (B*B*B)  . 

where  t  (k)  -*■  0  when  k  We  also  know  that  llx^(t)ll  _<  llF(Kg)ll  +  1  and  xk<t)  £ 

co(Kq)  ,  which  is  compact.  Hence  the  assumptions  of  the  convergence  theorem  (See  Aubin- 

Cellina-Nohel  (11)  are  satisfied:  A  subsequence  of  xk(-)  converges  uniformly  over 

compact  intervals  to  a  solution  x(«)  of  the  differential  inclusion  x'e  F(x).  More- 

oo  n 

over,  the  sequence  of  derivatives  xk(’)  converges  to  x’(-)  in  L  (0,T ;TR  )  sup- 

CO  2. 

plied  with  the  weak  topology  o(L  ,L  )  . 


On  each  point  of  the  grid,  the  following  inequality  hold: 

(12)  Vtx^t^1))  -  v^tiP))  +  hpW(xk(xP)  ,vk(xP))  <^hp/k  . 

By  summing  these  inequalities  from  p=q  to  p=r-l ,  we  obtain , 

r-1  (t5  -  x? ) 

V(xk(Tk))  "  V(xk(Tk))  +  ^  hSUx^x^),  v  (xp))  <_ - - -  . 

p-q 

We  remark  that  v^tt)  =  x£(xP)  on  thG  interval  txP,xP+1(  ’  So'  we  can  wr*te 
the  above  inequality  in  the  form: 


V(y.  (x l))  -  V(y  'x^))  +  /  k  W(y  (x),v  (T))dx  < 


-  % 


We  recall  that  xk(*)  converges  to  x(*)  uniformly  on  compact  intervals;  so 
does  yk(*).  We  also  know  that  x£(«)  converges  weakly  to  x’(*)  in  L  (0,T;X);  so 


does  vk  ( • ) . 
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* 

l 


» 


I 


We  assume  for  a  while  that  the  following  Proposition  holds  true  (See  Ekeland- 
Temam  [1]). 


Proposition  1 

Assume  that  the  function  W:K  *  L  ->■  +  is  nonnegative,  lower  semicontinuous 

and  convex  with  respect  to  v  .  Then,  for  all  compact  convex  subset  M  c  l  ,  the 
functional  W  defined  by 

(14)  W(x,v)  =  W(x(t)  ,v(T))di  e  [0,»] 

0 

is  lower  semicontinuous  on  C( 0,“;K)  x  L  (0,»;M)  when  C(0,»;X)  is  supplied  with  the 

topology  of  uniform  convergence  on  compact  intervals  and  with  the  topology 

00  1  00 

induced  by  the  weak  topology  o(L  ,L  )  on  L  (0,«°;X).  • 

End  of  the  proof  of  Theorem  1 

By  Proposition  1,  we  deduce  that  for  all  s  >  t  , 

(15)  /S  W(x(t)  ,x'  (T))dt  <_  lim  inf  /s  W(y.  (x),v  (x))dx  . 

t  k  -*■  «  t  K  * 


Since  we  can  approximate  s  by  x£  and  t  by  x?  with  x*  >_  x^  for  k  large  enough, 
we  deduce  from  the  continuity  of  V  that  V (x^ (x^) )  converges  to  V(x(s))  and 
Vtx^fi^))  converges  to  V(x(t)).  Also,  since  w  is  continuous,  it  is  bounded  on 
K0  *  F(V  and  thus<  /  k  W(x(t)  ,x'  (t)  )dT  converges  to  /S  W(x(x)  ,x'  (t)  )dt .  Hence, 

Tk 

we  can  take  the  limit  when  k  -►  <»  in  inequalities  (13):  we  find  that  x(«)  satisfies 
the  monotonicity  condition 

v  s  >  t\  V(x (s) )  -  V (x (t) )  +  /S  W(x(t)  ,x*  (t)) dr  <_  0  . 

t 

When  F (K)  is  bounded,  we  have  chosen  T  independent  of  xQ  .  So  we  can  extend  the 
trajectory  x(«)  on  [0,T]  on  a  trajectory  on  [0,2T],  [0,3T],  etc.  So,  there  exists 
a  trajectory  defined  on  [0,"[  ,  ■ 

Proof  of  Proposition  1 

Let  xk(>)  converging  to  x(-)  uniformly  on  compact  intervals  and  vk<')  con¬ 
verging  weakly  to  v(*)  in  L  (0,~;X).  Hence 

(16) 


i)  V  te  [0,“[,  *k<t)  converges  to  x(t) 


ii)  V  T  >  0  ,  v  (•)  converges  weakly  to  v(-)  in  L1(0,T;X). 
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rnmmm 


Actually,  it  is  sufficient  to  suppose  the  latter  properties  (16)  hold  true.  If 


(17)  c  =  lim  inf  W(x^,v^). 

k  •*  " 

There  exist  subsequences  (again  denoted  x  and  v  )  of  x  and  v  such  that 


By  Mazur's  theorem,  there  exists  a  sequence  of  elements 


0  but  for  a  finite  number  of  indexes  k)  that  converges  strongly  to  v(») 


(where  a, 


V  h  €  IN  ,  II  w  -  vll  .  <_  1/h  . 

"  L  (0,T;X) 

Hence,  a  subsequence  (again  denoted)  w  converges  almost  everywhere  to  v(*).  Let 


t  >_  0  be  any  point  where 


By  Proposition  14.2,  there  exists  n  such  that  EpW(x,*)  c  EpW(xlt),*)  +  e(B*B) 


when  II x  -  x(t)l!  <_  n  .  Let  k  such  that  II  x  (t)  -  x ( t ) II  •  n  whenever  k  -■  k 


is  convex,  we  deduce  that 


we  obtain 


Since  this  holds  true  for  all  c  >  0 


that 


that 


We  integrate  this  inequality  and  we  apply  Fatou's  lemma,  which  is  possible  for  W 


is  nonnegative.  We  obtain 
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We  consider  the  case  when  W  =  0  ;  in  this  particular  case,  we  say  that  V  is  a 
Liapunov  function  with  respect  to  F  if 

(1)  VxeK,  3  v  e  F(x  )  such  that  D+  V(x)  (v)  <_  0 

and  that  a  trajectory  x(-)  of  x'  e  F(x)  is  monotone  with  respect  to  V  if 

(2)  the  function  t  V(x(t))  is  nonincreasing. 

Hence  monotone  trajectories  remain  in  the  "level  sets" 

(3)  {x  e  K  |  V (x)  <_  V(xQ)  }  . 

So,  we  obtain  the  following  stability  property. 

Theorem  1 

Let  K  be  a  closed  subset  of  3Rn  and  F  be  a  bounded  upper  semicontinuous 
map  from  K  to  the  nonempty  compact  convex  subsets  of  3Rn  .  Let  V  :  K  •+  3R+  be 

a  continuous  lower  semicompact  Liapunov  function.  Let  =  {x  e  K  j  V(x„)  =  min  V(x)}. 

x  e  K 

Then  the  following  stability  property  holds : 

For  any  open  neighborhood  M  of  P,  »  there  exists  a  neighborhood  N  c  M  of 
P„  such  that,  for  all  xQ  e  N  ,  there  exists  a  trajectory  starting  at  xQ  and 
remaining  in  M  .  ■ 

Proof . 

We  set  Q  =  {x  e  K  |  V(x)  <_  min  V(y)  +  l},  which  is  compact.  Hence,  since  M 

y  e  K 

is  an  open  neighborhood  of  P*  ,  Q  n  M  is  compact  and  c  =  min  V(x)  is 

x  e  Q  n£  M 

finite.  Thus  the  subset  N  =  {x  e  Q  |  V (x)  <  c)  is  contained  in  M  and  is  a  neigh¬ 
borhood  of  P*  (for  V  is  continuous) .  Now,  if  x  e  N  ,  there  exists  a  trajectory 

0 

x(")  which  is  monotone  (by  Theorem  15.1)  and  thus,  which  remains  in  N  c  m  because 
V (x (t) )  _<  V(xQ)  <  c  .  ■ 

We  shall  give  now  conditions  implying  asymptotic  stability  when  WHO. 

Theorem  2 

Let  F  be  an  upper  semicontinuous  map  from  K  c  3Rn  to  the  compact  convex  sub¬ 
sets  of  IRn  and  V  be  the  restriction  to  K  of  a  locally  Lipschitzean  function  V 
which  is  lower  semicompact.  We  assume  that  V  is  a  Liapunov  function  with  respect  to 


F  statisying 


V  x  e  K  ,  if  there  exists  v  t  F(x)  such  that  D  V(x)  (v)  >_  0  , 

(4)  {  + 

i  then  V  (x)  =  min  V(y)  . 


We  also  assume  that 

(h)  the  function  (x,v)  graph  (f)  *>  D  V(x)(v)  is  upper  ^emi continuous . 

(This  is  the  case  when,  for  instance,  V  is  continuously  different iabl'"  or  copy  x 

continuous).  Then  any  monotone  trajectory  satisfies 

(6)  lim  V(x(t))  =  min  V(y)  . 

t  ->  «®  y  t  K 

Proof. 


We  set  v(t)  =  v(x(t)).  Let  us  assume  that  u  =  lim  v(t)  >  min  V(x)  >_  0  .  Let 

t  *■ 00  x  K 

Q  -  x  £  K  j  V  (x)  _V(x^)},  which  is  compact  because  V  is  lower  semicompact  and 

lowti.  .eraicontinuous .  Therefore,  the  graph  of  tin  restriction  to  Q  of  F  is 

compact,  for  F  is  upper  semi continuous  from  K  to  the  compact  subsets  of  Ipn  . 

Assumption  (4)  implies  that  D+  '’(:<)  (v)  0  for  all  (x,v)  F  ;  so,  we  deduce 

from  Assumption  (5)  that  there  exists  u  >  0  such  that 

(7)  V  x  •_  Q  ,  sup  D  V(x)  (v)  — u 

v  ■  F  (x)  + 

Let  x(*)  v?(Of°»;lRn  )  be  a  trajectory  such  that  x'(#)  <  L  (0,,x>;lFn)  .  Since 

x(t)  Q  for  all  t  >_  0  #  we  deduce  that  D+  V  (x  (t) )  (x*  (t ) )  <_  -p  .  Also,  because  V 

is  the  restriction  of  a  locally  Lipschitzean  function  V  ,  Proposition  6.8  implies  that 

v3)  lim  inf  v  <  D  v  (x  (t) )  (x- (t) )  <  -u  . 

h  ->  0+  h  -  +  ~ 

Therefore,  we  deduce  from  Proposition  6.9  that  for  all  T  =  j  we  have 

(9)  v  (T)  -  v  (0)  £  fT  -u  dt  =  -v  (0)  . 


0 

Thus  v(T)  _  0  min  V(x)  and  v(T)  >  a  min  V(x)  . 

X  f  K  ~  x  K 


The  theorem  follows  from  this  contradiction. 


Liapunov  function.  When 


17 .  Liapunov  functions  for  U-monotone  maps. 

Let  U  :  K  x  JC  3R+  be  a  nonnegative  continuous  function  such  that  U(y,y)  = 
for  all  y  e  K  ,  which  plays  the  role  of  a  semidistance  (without  having  to  obey  the 
triangle  inequality) .  We  shall  associate  with  U  the  class  of  "U-monotone"  maps 
F  which  enjoy  the  following  property.  If  we  know  in  advance  that  e  K  is  a 

stationary  point  of  F  ,  then  the  "distance  function"  to  xA  :  x  -*  U(x#xA)  is  a 


u<x,y)  =1  I  |x.  -  yj2 

1=1  1  1  ' 


the  class  of  U-monotone  maps 


coincides  with  the  class  of  monotone  maps  in  the  usual  sense. 


We  list  some  examples  of  functions  U 
u  (x,y>  =  l  I*.  -  y, lp 


and,  in  particular,  for  p  =  2: 

.  i  P 

(2)  U2(x,y)  =  -  l  |*A  -  yj 

i=l 

We  mention  also 


(3)  U^tx.y)  =  max  (x.  -  y.) 

i=l,...,n  1 

o  n 

and,  if  K  =  E  , 

'  + 


(4)  UQ(x,y)  =  max  x^y^  -  min  x^/y^  •  ■ 

i=l , . . . ,n  i=l, . . . ,n 

We  associate  with  U  the  function  U‘  defined  on  K  x  K  «  X  by 

(5)  U1  (x,y)  (v)  =  D  (x  (*■  U(x,y) )  (x)  (v)  . 

Now ,  we  introduce  the  class  of  U-monotone  set-valued  maps . 

Definition  1 

Let  U  :  K  x  K  •+  1R+  be  a  continuous  function  such  that  U(y,y)  =  0  for  all 

y  e  K  .  We  say  that  a  set-valued  map  from  K  to  3Rn  is  U-monotone  if 

(6)  V  x,y  e  K  ,  u  e  F<x),  v  e  F(y) ,  U*  (x,y)  (v-u)  <_  0  . 

We  say  that  F  is  strictly  U-monotone  if 

(7)  V  x,y  e  K  such  that  U(x,y)  >0  ,  V  u  e  F  (x)  ,  v  e  F  (y )  ,  U'(x,y)  (v-u)  <  0 
and  strongly  U-monotone  if  there  exists  c  >  0  such  that 


Finally,  if  f  is  a  bounded  continuous  map  from  IK+  to  IP  ,  we  say  that  F  is 
{•? ,  U )  -monotone  if 

(9)  V  x,y  £  K  ,  u  £  F  (x)  ,  v  e  F  (y)  ,  O'  (x,y)  (v-u)  +  s5(U(x,y))  <_  0 

Examples  of  U-monotone  operators 

When  we  take  K  =  IRn  and 
+ 

1  "  7 

(10)  U2(x,y)  =  J  l  |x.  -  y  r 

i=l 

we  see  that  F  is  (v*  ,U^)  -monotone  if 

til)  v  x,y  e  K  ,  u  £  F  (x) ,  v  £  F  (y) ,  <  u-v,x-y  >  >_  (U2  (x,y) )  . 

So,  usual  monotone  maps  are  the  U2 -monotone  maps. 

When  1  <  p  <  <»,  we  set 


(12) 

and 

U  (x,y)  =  -  I  |: 
P  P  i=l 

(13) 

!0(x,y)  =  (i  |  x. 

Therefore,  F  is  (^>,1 

v  f  F(y) , 

we  have 

(14) 

l  |x.  -  ' 

Ml0(x,y)  1  ' 

when  p 

=  we  set 

(16) 

and 

U  (x,y)  =  max 

i=l.... 

(17) 

0 (x,y)  =  (i  I  x.  ■ 

Then 

we  have 

F  is  (*£  ,Um)  -moi 

(18) 

min  (u.  -  v. ) 

jej (x,y)  1 

Finally, 

if  x  and  y  e  1$ 1 
+ 

(19) 

and 

UQ(x,y)  =  max 

i=l,  •  • 

I  P-2. 


i=l, . . . ,n 


x.  x. 

i  i 

—  -  min  — 

V, 


i=l,...,n  Yi  i=l,...,n  Yi 


F(y)  , 
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mm 


max 


[Note  that  UQ(x,y)  =0  if  and  only  if  3  A  ^  0  such  that  x  -  Ay 

on 

Then  F  is  OP  ,U  ) -monotone  if  and  only  if  for  all  x,y  e  3R 


ram 

i  e  K  (x,y) 


max 

jeK_ (x,y) 


The  above  characterizations  follow  obviously  from  the  computation  of  the  con 


tingent  derivatives  of  x  -►  U(x,y).  Since  these  functions  are  convex  and  continuous 


the  contingent  derivatives  coincide  with  the  directional  derivatives  from  the  right 


When  1  < 


Then  it  is  clear  that 


we  have 


max 

jej (x,y) 


Finally,  for  p  =  0  ,  we  have  U'(x,y)(v) 


max  — 
ifK  (x ,y)  yi 


min  — 
icK  (x,y)yi 


The  U  -monotone  maps  enjoy  the  following  fundamental  properties 


Theorem  1 


Let  U  be  a  continuous  nonnegative  function  from  K  x  K  4  ®  such  that 


U(y,y)  =  0  for  all  y  e  K  .  Let  F  be  a  proper  bounded  upper  semicontinuous  map 


from  K  to  the  compact  convex  subsets  of  1R  .  We  also  posit  the  following  assump 


i)  there  exists  a  stationary  point  xA  e  K  of  F 


ii)  -F  is  (<£,U)  monotone 


Let  w  c  C(0,®;3R)  be  a  solution  to  the  differential  equation 


,  x  is  given  in 


Then  there  exists  a  solution  x(*)  to  the  differential  inclusion  x1  crlxl, 


x(0)  =  xQ  such  that  t 
<  +“  and  such  that 


U(x(t),x4)  is  nonincreasing,  such  that  /  <KU  (x  (t)  ,x„) )  dt 

0 


(24)  V  t  _>  0  ,  U (x (t)  ,x.)  _<  w(t)  . 

Proof. 


We  set  V (x)  =  U(x,xt)  and  W(x,v)  =  ^(U(x,xt)).  Since  0  e  Fix*),  then, 
for  all  v  e  F(x) ,  we  get  D+V(x) (v)  +  W(x,v)  =  U' (x,x4) (v  -  0)  +  * (U(x,x„) ) . 

The  right-hand  side  of  this  inequality  is  nonpositive  since  -F  is  (<£,U)  -monotone. 
Hence  V  is  a  Liapunov  function  for  for  F  with  respect  to  W  .  So,  we  apply 
successively  Theorems  15.1  and  12.3.  ■ 

We  mention  now  a  result  on  asymptotic  stability.  For  simplicity,  we  prove  only 
a  special  case. 

Theorem  2. 

Let  L  c  ]Rn  be  an  open  convex  subset  of  ipn  and  OiL  <  L  +  P  be  a  non- 

+ 

negative  continuous  function  such  that 


(25) 


i)  V  y  e  L  ,  U(y,y)  =  0 

ii)  V  y  e  L  ,  x  f*-  U(x,y)  is  convex. 


Let  K  be  a  closed  subset  of  L  and  F  be  a  bounded  upper  semicontinuous 
map  from  K  to  the  compact  convex  subsets  of  ]Rn  .  We  assume  also  that 
i)  there  exists  a  stationary  point  xt  e  K  of  F 

(26)  ii)  V  X  €  K  ,  Dr(x)  n  F(x)  /  0 

iii)  -F  is  strictly  U-monotone. 

Then,  for  any  xQ  e  K  ,  there  exists  a  solution  to  the  differential  inclusion 
x'  e  F (x) ,  x(0)  =  xQ  satisfying 

(27)  lim  U(x(t),xt)  =  0 

t4  ® 

proof. 

We  take  for  Liapunov  function  the  restriction  vjR  of  the  function  V  defined 
on  L  by  V(x)  =  U(x,x4),  where  xt  is  a  stationary  point  of  F  .  Since  V  is 
convex  and  continuous,  then  D+  v(x)(v)  =  D_  v(x) (v)  is  upper  semicontinuous  with 


respect  to  (x,v).  It  is  a  Liapunov  function  since  there  exists  v  £  D^lx)  n 

by  assumption  (26)  ii)  ■.  Hence  D+  v|R(x)(v)  V(x)lv)  =  D+  V(x)(v)  = 

U' (x,x4)  (v  -  0)  <_  0  because  v  e  Fix),  0  £  Fix,,)  and  -F  is  U-monotone.  Also, 

let  us  assume  that  there  exists  v  £  F (x)  such  that  D+  Vlx) (v)  >_  0  .  Then 

U'  (x,x„)  Iv  -  0)  >_  0  and,  since  v  £  Fix),  0  e  Fix,)  and  -F  is  strictly  monotone 

we  deduce  from  (7)  that  Vlx)  =  U(x,x„)  =  0  =  min  V(y).  Therefore  assumptions  of 

y  £  K 

Theorem  16.2  are  satisfied  and  thus,  any  monotone  trajectory  statisfies  property 
127).  They  do  exist  by  Theorem  15.1.  ■ 

Remark 

We  recall  that  the  Browder-Ky  Fan  theorem  states  that  when  K.  is  convex  and 
compact,  the  tangential  condition  (26)  ii)  implies  the  existence  of  a  stationary 


point  x,  e  K 


18. 


Construction  of  Liapunov  functions 

If  the  dynamical  system  described  by  the  set-valued  map  F  :  K  c  ir"  -*  ipn  and 
the  function  W:K  x  F  (K)  -*•  IR+  are  given,  the  problem  arises  whether  there  exist  a 
Liapunov  function  V  .  By  Theorems  14.1  and  15.1  ,  we  have  to  find  functions  V 
satisfying  the  property 

(1)  V  x  e  K  ,  jv  e  F(x)  such  that  D+  V(x)  (v)  +  W(x,v)  <_  0  . 

For  this  purpose,  we  denote  by  T^tx^)  the  set  of  viable  trajectories  of  the  dif¬ 
ferential  inclusion 

(2)  x'  e  F(x),  x(0)  =  xQ  given  in  K  . 

We  define  the  function  from  K  to  10,+“]  by 

(3)  V  x  e  K  ,  V  (x  )  =  inf  /  W(x(t)  ,x'  (t)  )dr. 

F  °  x(-)eToo(xQ)  0 

We  begin  by  pointing  out  the  following  remark. 

Proposition  1 

Let  V:K  •+  IR+  and  W:K  x  f(K)  IR+  be  nonnegative  functions.  If  there  exists 

a  monotone  trajectory  x(* )  e  7^ ( x^ )  (with  respect  to  V  and  W)  then 

(4)  0  <  V  (x.)  <  V (x  )  .  ■ 

—  F  0  —  0 

Proof  It  follows  from  Proposition  12.1  and  from  inequality 

V  t  >  0  ,  /fc  W(x(T)  ,x*  (x))dT  <_  V(xQ)  -  V  (x  (t) )  V(x0>  .  • 

We  now  prove  that  V  Does  satisfy  the  Liapunov  condition  for  F  with  respect  to  W  . 

F 

Proposition  2 

Let  K  c  iRn  be  closed,  F : K  -*■  lRn  be  a  proper  upper  semicontinuous  map  with 

compact  convex  images  and  W:K  x  co(F(K))  ■*  IR+  be  a  nonnegative  lower  semicontinuous 

function  that  is  convex  with  respect  to  v  .  If  the  minimum  in  V  <x„)  is  achieved 

F  0 

for  Xg  e  K  ,  Vp  satisfies  the  Liapunov  condition 

(5)  3  v0  t  F<x0>  such  that  D+Vp(xQ)(v0)  +  W(xQrv0)  <^0  ■ 

Proof. 

Let  us  assume  that  there  exists  x(»)  e  T  (x„)  such  that  V  (x„)  = 

•  0  F  0 

/Q° 

W(x ( t ) ,x' (t) )dx .  Since  F  is  upper  semicontinuous,  we  can  associate  with  any 

0 

e  >  0  an  n  >  0  such  that,  for  all  x  e  xQ  +  e  B  ,  F(x)  c  F(xQ)  +  e  B  .  So,  for  h 
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Proof 


Since  there  exist  monotone  trajectories  x ( • )  e  T  (x. )  with  respect  to  V  and  W 

for  all  Xg  e  K  ,  we  deduce  from  Theorem  14.1  that  V  is  a  Liapunov  function  for  F 

with  respect  to  W  ,  from  Proposition  1  that  v^tx^)  V(XQ)  f°r  xo  £  K  and  ^rom 

Proposition  2  that  is  a  Liapunov  function.  The  set-valued  map  -*  T^tx^)  from 

K  to  the  space  of  functions  x(-)  e  C(0,°°;lRn)  whose  derivatives  x'(')  e  L  (0 ^iTR1  ) 

is  upper  semicontinuous  with  compact  values  when  C(0,«°;3Rn)  is  supplied  with  the 

topology  of  uniform  convergence  on  compact  intervals  and  when  L°°(0,";IRn)  is  supplied 

00  2. 

with  the  weak  topology  o(L  ,L  ).  Proposition  15.1  states  that  the  functional 

X  \-  r  W(x(t),X-  (T))dT  is  lower  semicontinuous  on  that  space.  Hence  the  maximum 
0 

theorem  implies  that  the  function  ( • )  is  lower  semicontinuous.  ■ 

Another  combination  of  the  same  arguments  yield  the  following  statement: 

Theorem  2 

Let  F  be  a  bounded  upper  semicontinuous  map  from  a  closed  subset  K  c  IRn  to 
the  compact  convex  subsets  of  3Rn  ,  satisfying  the  tangential  condition 

(7)  V  x  e  K  ,  F (x)  n  Dk<x)  ?  0  . 

Let  W  :  K  x  coF(K)  -*■  IR+  be  a  nonnegative  lower  semicontinuous  function  which 
is  convex  with  respect  to  v  .  If  for  xQ  e  K  ,  VF(xQ)  is  finite,  then  V^lx^)  is 
lower  semicontinuous  at  xQ  and  satisfies 

(8)  3  v  e  F(x  )  such  that  D  V  (x  )  +  W(x  ,v  )  <  0  . 

yJ  U  +  F  0  0  0  “ 

Consequently,  if  is  finite  on  K  ,  it  is  a  lower  semicontinuous  Liapunov 

function  for  F  with  respect  to  W  .  ■ 

The  fact  that  v  is  a  Liapunov  function  yields  the  following  characterization  of 
trajectories  achieving  the  minimum  of  vp  . 

Proposition  3. 

Let  us  assume  that  the  function  Vp  defined  by  (3)  is  finite  on  K  and  is  a 
Liapunov  function  for  F  with  respect  to  W  .  Then  the  trajectories  of  the  differ¬ 
ential  inclusion  x1  e  F(x),  x(0)  =  xQ  ,  which  are  monotone  with  respect  to  and 

W  achieve  the  minimum  in  V  (x„) .  ■ 

F  0 
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If  x(*)  is  a  monotone  trajectory  with  respect  to  V  and  W  ,  we  obtain  the 
inequality 

(9)  /  W  (x(t)  ,x'  (t)  )dr  <_  V  (x  )  =  inf  /  W(y  (x)  ,y ' (t)  )dt .  ■ 

0  F  0  y  (• )  cT  (x  )  0 

00  U 

This  simple  statement  is  a  very  important  consequence  in  control  theory.  We  associate 
with  Vp  the  new  map  G  defined  by 

(10)  G (x)  =  (v  €  F(x)|d  V  (x)  (v)  +  W(x,v)  =  min  (D  V  (x) (w)  +  W(x,w))}  . 

+  F  weF  (x)  +  F 

Note  that  G(x)  is  single-valued  when  v  •»  D+  V^fx)  (v)  is  convex  and  v  }»  W(x,v) 

is  strictly  convex  for  all  x  £  K  .  One  can  devise  sufficient  conditions  implying  that 

(x,v)  ■*  D  V  (x) (v)  is  upper  semicontinuous .  This  and  the  continuity  of  W  guarantees 
+  F 

that  G  is  an  upper  semicontinuous  map. 

In  any  case,  by  Theorem  16.1,  solutions  x ( • )  of  the  differential  inclusion 

x'  £  G(x),  x(0)  =  xQ  yield  trajectories  of  x'  e  F(x),  x(0)  =  x^  which  achieve 

the  minimum  in  V  (x  ) .  ■ 

F  0 


I 


19.  Construction  of  dynamical  systems  having  monotone  trajectories 

The  question  arises  whether  V  and  W  being  given,  there  exists  a  continuous 
single-valued  map  f  such  that  the  differential  equation  x'  =  f (x)  has  monotone 
trajectory  with  respect  to  V  and  W  . 


In  this  section,  we  shall  assume  that 


i) 

K 

is 

compact  and  convex 

(!) 

ii) 

V 

is 

the  restriction  to  K 

of  a  convex 

continuous  function  V 

iii) 

W 

is 

continuous  and  convex 

with  respect 

to  v  . 

We  recall  that  a  necessary  and  sufficient  condition  for  f  to  have  monotone  trajectories 
with  respect  to  V  and  W  is  that 

(2)  V  x  e  K  ,  D+  V(x)  (f  (x) )  +  W(x,f(x))  <_  0  . 

Since  D,  V(x)(v)  is  the  restriction  to  the  tangent  cone  D  (x)  of  D  V(x)(v),  we  set 
+  K  + 

(3)  S(x)  =  (v  £  X  |  D+  V(x)  (v)  +  W (x , v)  _<  0  }  . 

So,  the  necessary  and  sufficient  conditions  can  be  written 

(4)  V  x  e  K  ,  f  (x)  e  Six)  n  dr(x)  . 

In  order  to  exclude  the  obvious  solution  f  =  0  ,  we  introduce  the  cones 

(5)  S  (x)  =  {v  £  X  |  D+V(x)(v)  +  W (x,v)  <  0}. 
which  may  be  empty.  We  also  set 

(6)  KQ  =  {x  e  K  |  S(x)  h  Dk(x)  ?  fl  };  =  K  n  £  KQ  . 

Theorem  (Cornet) 

Let  K  be  a  compact  convex  subset,  V  be  the  restriction  to  K  of  a  continuous 
convex  function  V  and  W  be  a  nonnegative  continuous  function  on  K  x  3Rn  which  is 
convex  with  respect  to  v  .  We  assume  that  the  subset  KQ  defined  by  (6)  is  nonempty. 
Then  there  exists  a  continuous  function  f  whose  set  of  stationary  points  is 


such  that  the  differential  equation  x'  =  f (x) ,  x(0)  =  x^  has  a  monotone  trajectory 
with  respect  to  V  and  w  .  ■ 


Proof . 


Since  (x,v)  «•  D+  V(x)  (v)  is  upper  semicontinuous ,  the  graph  of  the  map  S  , 
which  is  equal  to 

Graph  S  =  {  (x,v)  £  K  *  ®n  |  D  V(x) (v)  +  W(x,v)  <  0  } 

*  u  + 

is  open.  Since  the  set-valued  map  x  -*■  Dj,(x)  is  i.s.c.  and  has  convex  values  x  ■+ 

°  n 

S(x)  n  dk(x)  is  locally  selectionable  from  KQ  to  IR  and  its  images  are  convex 
cones.  (See  Cornet  [1]).  Hence,  by  results  of  Corret  [1],  there  exists  a  continuous 
function  f  from  K  ot  3Rn  satisfying 

(7)  V  x  £  KQ  ,  f  (x)  £  Dr(x)  n  S(x)  and  V  x  £  ,  f(x)  =  0  . 

So,  such  a  function  f  satisfies  the  assumptions  of  Theorem  15.1.  Hence  there  exists 
monotone  trajectories  of  the  differential  equation  x'  =  f (x) .  ■ 
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20.  Feedback  controls  yielding  monotone  trajectories. 


Let  u  be  a  set  of  controls  u  and  f  :  K  x  0  ■»  X  the  map  that  assigns  to  each 
state  x  and  to  each  control  u  the  velocity  f(x,u)  of  the  state. 

A  feedback  control  is  a  map  u  :  x  c  K  •+■  u(x)  e  U  associating  with  each  state  of 
the  system  a  control  according  to  a  fixed  rule  for  achieving  a  given  purpose. 

The  example  of  such  a  purpose  is  the  requirement  that  the  trajectories  of  the 
differential  equation 

i)  x'  (t)  =  f  (x(t)  ,u(x(t))) 
ii)  x(0)  =  0 
exist  and  satisfy  the  monotonicity  condition: 

(2)  V  s  >  t  ,  V  (x(s) )  -  V  (x  (t) )  +  Is  W(x(t),x’  (t)  )dT  <_  0  . 

t 

We  assume  that  V  is  the  restriction  to  K  of  a  convex  continuous  function  V  . 

o 

We  introduce  the  following  set-valued  map  S  defined  by 

(3)  S(x)  =  {v  t  x|d+  V(x)  (v)  +  W(x,v)  <  0  } 
and  we  set 

(4)  Kq  =  {X  c  K  !  S(x)  n  nK<x)  ;<(?},  Kj  =  K  n  £k  . 

Theorem  1 

Let  us  assume  that  K  ■  X  and  u  are  both  convex  compact  subsets,  that  U 


contains  0  and  that  F  :  K  •  U  -*■  X  is  a  continuous  map  that  is  linear  with  respect 
to  the  controls  .  Wo.  assume  that  KQ  ^  JJ  and  that  there  exists  y  >  0  such  that 
[  v  x  K  ,  v  y  c  x  ,  llyll  <  y  ,  3  u  «  U  such  that 

<5> 

1  f(x,u)  -  y  t  Dr(x)  n  S (x)  . 

Then  there  exists  a  feedback  control  u  r  C(K,U) ,  vanishing  on  that  provides 

monotone  trajectories  with  respect  to  V  and  W  .  ■ 

Proof. 


By  Theorem  15.1,  we  have  to  prove  the  existence  of  a  feedback  control  u  r  C(K,f) 
such  that 


Let  us  set,  if  x  £  Ko  ' 

(7)  G (x)  =  {u  £  0  j  f(x,u)  e  f>K(x)  n  • 

O 

We  already  mentioned  that  x  ^  D^(x)  n  S(x)  is  locally  selectionable  and  thus, 
lower  semicontinuous .  Assumption  (5)  implies  that  G  is  lower  semicontinuous  on 
(See  Aubin  and  Cellina  [1]). 

Michael's  theorem  states  that  there  exists  a  continuous  selection  v  €  C(KQ,U)  of 

the  set-valued  map  C  .  We  denote  by  d  (x)  the  distance  from  x  to  K  and  we 

K1  1 

set : 

d  (x)  v(x)  if  x  e  K 

(8)  u  (x)  =  j  K1  0 

0  if  x  e 

This  function  u  is  continuous  on  K  .  It  is  obviously  true  when  x  £  .  Let  us 

check  that  it  is  continuous  at  x  e  .  Let  e  >  0  and  y  e  x  +  e  B .  Then 

u(x)  =  0  and  either  u(y)  =  0  (when  y  e  K  )  or  u(y)  <  d  (y)M  <  c  where 

1  -  Kx 

*  M  =  Hull  .  Then  llu(x)  -  u(y)ll  =  II  u(y)ll  <_  £  M  .  Hence  u  is  continuous.  Since 

v(x)  e  G(x)  and  since  f  is  linear  with  respect  to  the  controls,  we  deduce  that 

»  f(x,u(x))  =  d  (x)  f (x , v (x) )  €  D  (x)  n  s(x) 

*v  -»  K 

when  x  e  Kp  and  that  f(x,u(x))  =  0  when  x  e  .  ■ 


) 


-83- 


We  shall  adapt  to  the  time  dependent  case  the  results  we  proved  for  the  time  inde¬ 


pendent  case.  We  only  have  to  use  the  classical  transformation  which  amounts  to 
observing  that  the  solutions  to  the  differential  inclusion 

(1)  x'  (t)  e  F(t,x)  ;  x(tQ)  =  xQ 

and  the  solutions  x  f*  (t(T),x(x))  =  x(x)  of  the  differential  inclusion 

(2)  x‘  e  F (x)  ,  x (0)  =  (t0.x0) 
where  we  set 


(3) 


(4) 


V  (t,x)  =  x  e  Dom(F)  F(x)  =  (l,F(t,x))  . 

We  shall  denote  by  K  =  Dom  F  the  domain  of  F  ,  which  is  the  domain  of  K  . 
We  introduce 

(  i)  a  nonnegative  function  V  from  K  to  3R 


^  ii)  a  nonnegative  function  W  from  K  *  coF  (K)  to  K  . 

Now,  the  symbol  D+  V(t,x)(l,v)  denotes  the  upper  contingent  derivative  of  V  at 

(t,x)  in  the  direction  (l,v).  We  recall  that  when  v  is  differentiable,  we  have 

(5)  D  V (t ,x)  (1  ,v)  =  —  V (t ,x)  +  7  - — V(t,x)v.  . 

+  3t  L  3x.  l 

1=1  i 

Proposition  1 

x(*)  is  a  monotone  trajectory  of  the  differential  inclusion  (2)  with  respect  to 

V  and  w  if  and  only  if  x(»)  is  a  trajectory  of  the  differential  inclusion  (1) 

which  is  monotone  with  respect  to  V  and  w  in  the  sense  that 

V  s  >_  t  ,  V(s  ,x(s) )  -  V(t,x(t) )  +  /  W(t,x(t)  ,x'  (t)  )dx  <  0  . 

0 


Proof. 

Indeed,  x(*)  is  a  solution  to  (2)  if  and  only  if  x(t)  =  (t,x(t))  where  x(*) 

is  a  solution  to  (1).  Note  that  x' (t)  =  (l,x'(t)).  So,  Condition  (6)  is  equivalent 

to  V  s  _>  t  ,  V(x(s))  —  V(x(t))  +  J°°  W(x(T),xU))dT  <  0  .  ■ 

0 

We  introduce  now  the  concept  of  Liapunov  function . 
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has  a  monotone  trajectory  x(»)  e  C(tQ # <*>;  3Rn  )  for  all  tQ  _>  0  and  €  K(tQ)  if  and 
only  if  V  is  a  Liapunov  for  F  with  respect  to  W  .  ■ 

We  mention  also  the  following  adaptation  of  Theorem  18.2. 

We  denote  by  T^t^x^)  the  set  of  solutions  x(*)  e  C(tQ#®;x)  of  the  differ¬ 
ential  inclusion  (1).  We  introduce  the  function 

(12)  V  (t  ,x  )  =  inf  /"  W(t,x(t)  ,x'  (t))dx. 

x(-,tT»(to'x0)  0 

Theorem  2 

Lot  F  be  a  bounded  upper  semicontinuous  map  from  a  closed  graph  of  a  set-valued 

map  K(*):1K+  >  IK  to  the  compact  convex  subsets  of  IRn  ,  satisfying 

(13)  V  t  >_  0  ,  V  X  c  K(t),  F(t,x)  n  D  K(t,x)(l)  *  0  . 

Let  W  :  K  *  co(F(K))  >  1R+  be  a  nonnegative  lower  semicontinuous  function  which  is 
convex  with  respect  to  the  last  argument.  If  for  all  (tQ,xQ)  c  K  ,  the  function 
is  finite,  it  is  the  smallest  nonnegative  lower  semicontinuous  Liapunov 
function  for  F  with  respect  to  W  .  ■ 

If  V  (tQ,x^)  is  a  liapunov  function  for  F  with  respect  to  W  ,  then 

(14)  inf  (D  V(t,x)(l,v)  +W(t,x,v)]  ^_0  . 
v.:F(t,x) 

When  V  is  the  restriction  to  K  of  a  differentiable  function  V  ,  this  inequality 
can  be  written 

DV  r  7>v 

(15)  —  (t,x)  +  inf  [  2,  r—  (t,x)v.  +  W(t,x,v)]  <_  0  . 

V-  F(t,x)oDK(t,x) (1)  i=l  JXi  1 

Tnis  is  the  Cai atheodory-liami 1 ton-Jacobi-Bel lman  equation  of  control  theory.  " 
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